-- Logs begin at Mon 2022-02-21 01:49:47 UTC, end at Mon 2022-02-21 02:48:07 UTC. -- Feb 21 02:19:04.590543 dv-cinder-804470-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 02:19:04.599505 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 02:19:04 2022] *** Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: nodename: dv-cinder-804470-8-iscsi Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: machine: x86_64 Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: clock source: unix Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: pcre jit disabled Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: detected number of CPU cores: 4 Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: current working directory: / Feb 21 02:19:04.601453 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: detected binary path: /usr/bin/uwsgi-core Feb 21 02:19:04.602150 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: your processes number limit is 47680 Feb 21 02:19:04.602150 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: your memory page size is 4096 bytes Feb 21 02:19:04.602150 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: detected max file descriptor number: 2048 Feb 21 02:19:04.602150 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: lock engine: pthread robust mutexes Feb 21 02:19:04.602150 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: thunder lock: enabled Feb 21 02:19:04.602150 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 02:19:04.602150 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 02:19:04.646854 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: Python main interpreter initialized at 0x55a23f7db9c0 Feb 21 02:19:04.646854 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: python threads support enabled Feb 21 02:19:04.646854 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: your server socket listen backlog is limited to 100 connections Feb 21 02:19:04.646854 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: your mercy for graceful operations on workers is 90 seconds Feb 21 02:19:04.647181 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 02:19:04.647266 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: *** Operational MODE: preforking *** Feb 21 02:19:04.647506 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: *** uWSGI is running in multiple interpreter mode *** Feb 21 02:19:04.647506 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: spawned uWSGI master process (pid: 102070) Feb 21 02:19:04.647683 dv-cinder-804470-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 02:19:04.648221 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: spawned uWSGI worker 1 (pid: 102071, cores: 1) Feb 21 02:19:04.648557 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: spawned uWSGI worker 2 (pid: 102072, cores: 1) Feb 21 02:19:04.648727 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 02:19:06.496275 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 02:19:06.496275 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: from cryptography.utils import int_from_bytes Feb 21 02:19:06.496930 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 02:19:06.496930 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: from cryptography.utils import int_from_bytes Feb 21 02:19:06.500832 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 02:19:06.500832 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: from cryptography.utils import int_from_bytes Feb 21 02:19:06.501326 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 02:19:06.501326 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: from cryptography.utils import int_from_bytes Feb 21 02:19:09.052686 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 02:19:09.053322 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 02:19:09.053406 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 02:19:09.053790 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 02:19:09.054049 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 02:19:09.054439 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.054565 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 02:19:09.054941 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.055011 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 02:19:09.055074 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.055319 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 02:19:09.055429 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.055688 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 02:19:09.055774 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.055946 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 02:19:09.056037 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.056300 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.056384 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.056626 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.056777 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.056955 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.057048 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.057216 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.057314 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.057529 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.057630 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.057920 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.058025 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804470-8-iscsi {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.058252 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.058355 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.058557 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.058643 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.058872 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.058961 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.059141 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.059227 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.059460 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.059546 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.059789 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804470-8-iscsi {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.059888 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.060107 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.060192 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.060416 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.060605 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.060718 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.061039 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.061137 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.061350 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.061447 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.061728 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.061818 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.062000 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.062089 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.062319 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.062510 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.062622 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.062827 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.062938 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.063135 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.063248 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.063450 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.063600 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.063789 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.063874 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.064106 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.064255 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804470-8-iscsi {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.064459 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.064647 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.064852 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.064933 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.065161 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.065282 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.065492 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.065616 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.065834 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.065933 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.066246 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804470-8-iscsi {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.066376 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.066567 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.066652 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.066887 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.067030 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.067193 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.067276 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.067523 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.067609 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.067846 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.067938 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.068168 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.068261 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.068491 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.068575 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.068801 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.068884 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.069112 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.069210 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.069422 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.069512 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.069768 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.069858 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.070078 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.070175 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.070385 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.070476 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.070637 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.070721 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.070946 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.071032 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.071269 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.071352 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.071590 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.071680 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.071914 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.072010 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.072167 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.072259 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.072418 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.072505 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.072738 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.072822 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.073061 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.073145 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.073371 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.073507 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.073696 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.073782 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.073978 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.074062 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.074234 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.074330 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.074560 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.074644 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.074888 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.074979 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.075193 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.075319 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.075502 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.075586 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.075811 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.075905 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.076120 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.076205 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.076431 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.076542 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.076739 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.076845 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.077046 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.077142 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.077358 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.077461 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.077699 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.077788 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.078009 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.078105 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.078336 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.078430 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.078650 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.078746 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.078959 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.079045 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.079279 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.079366 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.079598 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.079702 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.079906 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.079992 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.080275 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.080423 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.080619 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.080815 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.080906 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.080987 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.081221 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.081309 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.081523 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.081620 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.081800 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.081897 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.082100 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.082194 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.082406 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.082502 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.082723 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.082810 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.083028 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.083113 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.083334 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.083421 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.083640 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.083735 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.083938 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.084025 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.084245 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.084341 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.084548 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.084633 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.084851 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.084993 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.085157 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.085263 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.085463 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.085559 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.085786 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.085893 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.086093 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.086180 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.086395 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.086481 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.086696 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.086791 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.087004 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.087088 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.087316 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.087403 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.087618 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.087712 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.087923 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.088018 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.088226 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.088312 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.088528 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.088624 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.088847 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.088933 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.089150 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.089235 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.089456 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.089620 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.089781 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.089866 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.090088 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.090182 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.090391 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.090487 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.090708 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.090803 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.091014 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.091100 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.091318 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.091416 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.091638 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.091731 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.091940 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.092026 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.092245 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.092340 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.092561 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.092650 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.092867 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.092953 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.093169 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.093257 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.093469 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.093556 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.093793 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.093883 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.094096 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.094193 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.094399 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.094485 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.094700 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.094789 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.095001 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.095089 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.095300 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.095395 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.095602 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.096217 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.096425 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.096586 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.096734 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.096948 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.097036 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.097259 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.097355 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.097566 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.097691 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.097912 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.098007 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.098244 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.098333 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.098572 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.098657 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.098882 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.098979 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.099188 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.099277 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.099513 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:19:09.099599 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.099850 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.099945 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.100166 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.100259 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.100480 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.100567 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.100795 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.100891 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.101124 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.101209 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.101435 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.101522 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.101774 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.101881 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.102087 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.102183 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.102405 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.102487 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.102724 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.102818 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.103035 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.103129 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.103351 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.103439 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.103663 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.103799 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.104233 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.104341 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.104545 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.104639 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.104860 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.104956 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.105181 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.105268 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.105499 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.105630 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.105834 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.105939 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.106149 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.106245 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.106471 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.106564 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.106800 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.106886 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.107121 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.107207 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.107435 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.107523 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.107744 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.107838 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.108053 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.108148 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.108363 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.108452 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.108682 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.108771 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.109017 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.109112 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.109328 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.109414 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.109712 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.109804 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.109971 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.110071 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.110281 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.110385 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.110590 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.110684 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.110903 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.110991 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.111213 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.111374 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.112099 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.112197 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.112417 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.112505 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.112733 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.112906 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.113047 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.113134 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.113360 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.113453 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.113693 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.113797 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.114011 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.114103 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.114325 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.114418 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.114631 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.114725 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.114938 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.115024 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.115244 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.115330 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.115553 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.115642 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.115857 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.115947 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.116163 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.116299 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.116473 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.116567 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.116782 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.116869 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.117097 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.117183 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.117402 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.117489 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.117737 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.117826 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.118048 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.118147 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.118359 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.118454 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.118664 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.118751 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.118980 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.119075 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.119290 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.119377 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.119596 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.119690 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.119906 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.120043 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.120211 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.120305 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.120517 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.120603 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.120826 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.120921 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.121128 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.121220 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.121432 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.121518 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.121773 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.121880 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.122083 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.122176 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.122390 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.122477 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.122701 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.122790 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.123007 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.123092 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.123325 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.123412 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.123634 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.123721 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.123945 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.124038 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.124261 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.124348 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.124576 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.124664 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.124879 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.124975 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.125202 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.125288 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.125514 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.125602 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.125850 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.125950 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.126155 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.126251 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.126462 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.126556 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.126765 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.126852 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.127167 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.127264 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.127489 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.127670 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.127799 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.127988 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.128119 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.128295 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.128429 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.128600 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.128737 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.128911 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.129044 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.129217 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.129357 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.129521 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.129683 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.129877 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.129998 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.130188 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.130306 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.130493 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.130614 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.130796 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.130921 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.131097 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.131249 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.131441 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.131560 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.131749 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.131870 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.132091 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.132177 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.132425 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.132511 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.132742 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.132878 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.133065 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.133153 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.133377 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.133463 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.133716 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.133817 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.134028 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.134123 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.134339 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.134425 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.134650 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.134738 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.134960 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.135046 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.135277 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.135365 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.135586 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.135681 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.135901 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.135986 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.136209 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.136296 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.136529 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.136622 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.136836 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.136928 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.137153 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.137248 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.137456 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.137541 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.137798 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.137891 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.138115 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.138213 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.138438 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.138533 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.138747 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.138833 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.139067 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.139165 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.139374 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.139459 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.139686 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.139772 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.139994 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.140093 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.140303 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.140416 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.140611 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.140698 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.140918 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.141013 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.141235 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.141322 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.141544 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.141739 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.141911 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.142001 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.142180 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.142270 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.142500 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.142650 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.142935 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.143024 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.143266 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.143375 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.143577 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.143672 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.143907 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.144005 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.144223 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.144309 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.144545 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.144632 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.144857 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.144946 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.145174 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.145262 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.145495 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.145595 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.145835 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.145924 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.146151 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.146250 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.146463 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.146564 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.146769 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.146857 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.147076 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.147162 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.147386 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.147484 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.147700 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.147787 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.148007 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.148100 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.148314 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.148410 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.148622 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.148709 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.148935 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.149021 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.149242 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.149331 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.149545 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.149632 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.149873 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.149971 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.150185 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.150314 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.150494 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.150588 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.150804 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.150891 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.151113 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.151201 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.151427 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.151520 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.151730 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.151816 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.152036 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.152124 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.152359 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.152452 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.152666 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.152753 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.152971 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.153109 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.153276 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.153369 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.153573 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.153714 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.153929 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.154016 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.154240 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.154326 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.154542 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.154636 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.154848 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.154934 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.155164 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.155249 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.155474 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.155577 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.155787 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.155873 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.156095 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.156190 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.156403 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.156498 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.156716 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.156820 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.157023 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.157116 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.157331 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.157419 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.157653 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.157747 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.157969 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.158057 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.158823 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.158991 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.159154 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.159298 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.159439 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.159540 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.159752 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.159851 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.160067 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.160162 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.160380 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.160467 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.160689 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.160783 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.160999 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.161087 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.161310 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.161404 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.161623 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.161904 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.161991 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.162240 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.162326 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.162558 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.162646 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.162877 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.163127 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.163214 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.163468 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.163566 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.163792 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.163878 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.164116 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.164201 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.164443 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.164539 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.164752 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.164846 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.165064 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.165151 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.165372 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.165466 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.165701 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.165792 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.166014 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.166101 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.166322 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.166420 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.166627 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.166790 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.166931 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.167017 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.167241 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.167327 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.167547 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.167643 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.167851 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.167937 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.168154 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.168254 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.168459 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.168547 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.168772 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.168858 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.169078 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.169162 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.169387 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.169473 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.169716 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.169804 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.170038 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.170124 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.170345 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.170432 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.170681 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.170777 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.170950 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.171037 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.171254 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.171342 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.171574 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.171659 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.171885 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.171979 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.172194 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.172281 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.172504 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.172590 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.172855 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.172950 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.173161 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.173297 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.173468 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.173554 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.173860 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.174521 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.174669 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.174820 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.174968 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.175060 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.175258 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.175347 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.175570 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.175664 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.175880 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.175973 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.176184 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.176279 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.176495 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.176585 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.176804 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.176892 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.177112 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.177200 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.177419 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.177499 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.177747 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.177857 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.178056 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.178145 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.178360 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.178446 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.178674 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.178772 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.178980 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.179066 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.179277 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.179370 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.179579 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.179674 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.179887 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.179981 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.180192 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.180279 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.180494 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.180591 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.180802 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.180894 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.181100 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.181193 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.181414 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.181508 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.181742 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.181833 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.182050 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.182148 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.182356 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.182468 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.182660 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.182746 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.182967 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.183053 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.183270 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.183414 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.183576 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.183661 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.183886 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.183971 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.184190 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.184279 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.184493 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.184619 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.184800 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.184886 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.185102 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.185198 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.185405 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.185492 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.185734 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.185835 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.186049 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.186136 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.186358 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.186467 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.186667 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.186767 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.186981 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.187067 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.187289 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.187374 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.187593 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.187687 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.187898 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.187985 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.188203 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.188295 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.188507 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.188605 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.188809 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.188895 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.189113 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.189205 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.189431 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.189539 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.189766 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.189977 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.190135 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.190244 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.190362 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.190502 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.190660 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.190774 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.190960 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.191263 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.191607 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.191911 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.192062 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.192272 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.192399 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.192578 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.192717 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.192894 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.193029 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.193210 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.193340 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.193527 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.193666 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.193862 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.194014 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.194176 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.194325 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.194479 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.194699 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.194862 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.195000 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.195135 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.195323 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.195467 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.195652 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.195789 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.195972 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.196114 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.196286 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.196501 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.196638 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.196776 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.196929 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.197064 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.197205 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.197348 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.197511 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.197669 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.197855 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.197941 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.198159 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.198254 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.198466 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.198552 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.198774 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.198858 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.199092 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.199180 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.199404 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.199490 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.199715 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.199808 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.200027 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.200115 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.200340 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.200426 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.200653 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.200739 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.200965 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.201089 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.201278 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.201364 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.201589 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.201738 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.201928 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.202015 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.202242 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.202327 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.202814 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.202926 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.203009 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.203090 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.203168 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.203253 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.203482 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.203621 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.203802 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.203927 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.204112 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.204198 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.204427 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.204521 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.204732 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.204862 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.205579 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.205791 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.206117 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.206281 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.206427 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.206524 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.206737 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.206824 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.207053 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.207141 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.207366 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.207451 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.207683 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.207768 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.207996 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.208090 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.208302 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.208432 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.208723 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.208816 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.209038 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.209125 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.209352 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.209445 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.209690 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.209818 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.210003 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.210100 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.210312 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.210406 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.210626 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.210730 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.210936 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.211043 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.211253 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.211362 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.211562 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.211659 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.211869 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.211956 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.212194 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.212282 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.212504 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.212603 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.212829 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.212916 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.213179 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.213264 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.213514 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.213602 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.213857 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.213947 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.214172 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.214272 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.214487 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.214575 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.214822 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.214946 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.215137 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.215224 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.215467 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.215555 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.215801 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.215886 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.216109 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.216195 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.216424 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.216512 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.216734 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.216901 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.217062 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.217222 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.217389 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.217542 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.217723 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.217964 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.218063 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.218300 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.218422 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.218635 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.218724 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.218950 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.219082 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.219263 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.219349 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.219579 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.219666 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.219919 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.220006 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.220255 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.220341 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.220575 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.221285 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.221664 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.221769 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.221853 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.222103 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.222214 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.222433 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.222522 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.222756 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.222843 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.223074 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.223162 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.223387 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.223495 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.223698 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.223829 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.224027 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.224151 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.224337 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.224481 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.224654 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.224814 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.224969 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.225133 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.225282 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.225446 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.225589 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.225788 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.225910 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.226103 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.226233 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.226417 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.226541 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.226748 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.226867 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.227062 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.227185 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.227384 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.227513 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.227703 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.227834 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.228020 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.228142 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.228335 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.228469 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.228648 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.228781 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.229232 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.229326 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.229545 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.229632 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.229907 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.229996 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.230229 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.230315 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.230558 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.230654 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.230883 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.230969 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.231192 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.231277 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.231524 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.231637 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.231834 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.231922 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.232142 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.232228 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.232453 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.232555 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.232764 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.232852 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.233083 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.233176 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.233409 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.233505 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.233743 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.233833 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.234051 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.234143 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.234362 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.234450 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.234666 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.234753 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.234972 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.235059 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.235276 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.235373 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.235584 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.235671 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.235885 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.235975 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.236189 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.236302 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.236569 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.236732 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.236885 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.236988 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.237184 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.237273 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.237509 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.237596 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.237842 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.237980 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.238150 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.238238 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.238456 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.238543 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.238758 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.238854 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.239062 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.239215 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.239375 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.239465 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.239710 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.239807 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.240022 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.240109 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.240345 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.240439 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.240658 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.240758 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.240970 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.241057 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.241280 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.241375 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.241593 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.241711 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.241931 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.242019 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.242252 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.242347 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.242570 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.242666 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.242885 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.242973 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.243201 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.243295 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.243519 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.243608 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.243831 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.243918 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.244149 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.244245 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.244465 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.244561 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.244784 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.244870 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.245109 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.245301 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.245430 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.245627 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.245775 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.245960 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.246099 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.246273 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.246423 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.246586 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.246740 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.246900 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.247064 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.247214 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.247386 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.247527 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.247712 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.247839 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.248151 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.248246 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.248462 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.248550 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.248788 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.248875 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.249110 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.249206 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.249441 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.249529 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.249809 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.249912 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.250130 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.250220 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.250442 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.250549 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.250759 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.250852 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.251075 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.251169 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.251397 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.251488 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.251730 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.251840 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.252066 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.252216 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.252363 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.252507 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.252688 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.252839 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.252996 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.253156 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.253306 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.253483 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.253617 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.253836 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.253939 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.254161 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.254248 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.254524 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.254621 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.254840 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.254925 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.255151 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.255235 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.255461 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.255548 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.255780 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.255872 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.256103 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.256189 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.256421 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.256507 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.256733 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.256818 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.257046 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.257141 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.257363 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.257449 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.257703 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.257910 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.258020 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.258225 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.258342 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.258558 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.258645 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.258885 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.258971 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.259213 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.259309 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.259536 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.259623 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.259855 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.259941 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.260182 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.260270 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.260488 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.260586 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.260796 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.261044 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.261143 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.261370 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.261456 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.261779 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.261891 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.262049 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.262145 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.262361 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.262448 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.262665 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.262752 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.262984 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.263072 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.263293 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.263380 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.263613 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.263818 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.263914 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.264164 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.264299 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.264481 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.264578 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.264809 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.264905 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.265135 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.265222 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.265447 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.265575 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.265775 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.265864 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.266100 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.266187 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.266405 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.266491 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.266712 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.266935 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.267022 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.267284 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.267372 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.268123 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.268556 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.268726 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.268869 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.268869 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.269023 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.269103 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.269268 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.269404 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.269585 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.269738 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.269952 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.270053 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.270269 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.270358 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.270588 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.270692 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.270910 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.271011 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.271229 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.271325 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.271538 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.271626 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.271888 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.272002 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.272145 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.272244 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.272453 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.272540 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.272757 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.272853 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.273068 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.273156 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.273371 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.273473 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.273705 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.273798 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.274012 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.274101 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.274323 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.274408 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.274625 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.274713 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.274935 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.275034 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.275243 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.275330 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.275557 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.275696 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.275869 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.275964 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.276179 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.276266 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.276493 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.276588 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.276801 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.276887 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.277116 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.277249 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.277425 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.277519 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.277762 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.277850 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.278074 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.278174 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.278389 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.278513 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.278746 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.278924 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.279076 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.279260 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.279389 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.279583 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.279698 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.279924 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.280012 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.280257 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.280346 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.280566 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.280652 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.280877 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.280977 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.281185 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.281273 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.281507 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.281594 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.281842 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.281959 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.282155 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.282442 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.282532 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.282756 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.282851 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.283067 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.283184 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.283434 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.283598 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.283726 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.283987 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.284077 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.284308 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.284403 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.284619 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.284722 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.284929 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.285019 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.285245 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.285333 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.285558 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.285667 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.285903 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.285993 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.286218 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.286304 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.286530 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.286616 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.286844 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.286931 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.287155 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.287254 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.287465 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.287561 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.287775 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.287861 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.288083 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.288175 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.288393 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.288487 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.288708 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.288796 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.289021 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.289106 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.289329 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.289431 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.289691 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.289782 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.290018 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.290105 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.290341 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.290430 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.290669 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.290767 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.290985 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.291072 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.291303 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.291391 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.291620 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.291707 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.291928 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.292013 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.292248 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.292344 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.292555 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.292640 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.292885 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.292982 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.293194 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.293280 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.293536 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.293629 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.293887 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.293984 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.294195 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.294282 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.294500 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.294647 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.294805 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.294902 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.295115 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.295211 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.295446 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.295533 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.295780 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.295913 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.296097 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.296186 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.296410 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.296502 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.296720 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.296815 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.297044 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.297132 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.297353 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.297447 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.297700 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.297793 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.298028 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.298117 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.298335 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.298421 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.298644 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.298739 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.299488 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.299661 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.299814 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.299934 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.300088 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.300176 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.300405 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.300492 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.300717 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.300814 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.301027 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.301125 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.301338 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.301425 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.301686 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.301791 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.302016 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.302111 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.302323 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.302420 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.302649 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.302780 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.302967 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.303057 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.303287 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.303374 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.303598 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.303694 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.303907 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.303993 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.304220 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.304306 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.304533 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.304628 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.304845 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.304935 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.305157 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.305260 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.305466 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.305556 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.305801 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.305892 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.306117 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.306226 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.306432 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.306520 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.306754 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.306841 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.307080 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.307181 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.307401 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.307489 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.307716 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.307811 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.308053 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.308154 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.308366 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.308464 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.308678 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.308765 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.308999 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.309095 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.309315 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.309402 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.309625 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.309789 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.309951 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.310041 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.310197 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 02:19:09.310286 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.310592 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.310925 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.311262 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.311596 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.311944 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.312264 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.312613 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.312948 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.313269 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.313587 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.313923 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:19:09.314170 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 02:19:09.333533 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG oslo_db.sqlalchemy.engines [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:19:09.337632 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_db.sqlalchemy.engines [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:19:09.398302 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.context [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33d1b4dd-d433-46ca-94fc-ac9f89dc5606(cell1) {{(pid=102071) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 02:19:09.400483 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.context [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33d1b4dd-d433-46ca-94fc-ac9f89dc5606(cell1) {{(pid=102072) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 02:19:09.402592 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG oslo_concurrency.lockutils [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:19:09.404162 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG oslo_concurrency.lockutils [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:19:09.404691 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:19:09.404978 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG oslo_concurrency.lockutils [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:19:09.406285 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:19:09.406939 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG oslo_concurrency.lockutils [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:19:09.407178 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:19:09.409157 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:19:09.417833 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG oslo_db.sqlalchemy.engines [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:19:09.420394 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG oslo_db.sqlalchemy.engines [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:19:09.423475 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_db.sqlalchemy.engines [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:19:09.426956 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_db.sqlalchemy.engines [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:19:09.577769 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG oslo_db.sqlalchemy.engines [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:19:09.587033 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_db.sqlalchemy.engines [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:19:09.918105 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: WARNING keystonemiddleware.auth_token [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 02:19:09.920218 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: WARNING keystonemiddleware.auth_token [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 02:19:09.924828 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: WARNING keystonemiddleware.auth_token [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 02:19:09.926804 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: WARNING keystonemiddleware.auth_token [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 02:19:10.262060 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: WARNING keystonemiddleware.auth_token [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 02:19:10.267219 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: WARNING keystonemiddleware.auth_token [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 02:19:10.268700 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: WARNING keystonemiddleware.auth_token [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 02:19:10.272898 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a23f7db9c0 pid: 102071 (default app) Feb 21 02:19:10.273885 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: WARNING keystonemiddleware.auth_token [None req-c04d2d46-1eca-4b35-97ee-e993a03bfac9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 02:19:10.275018 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:19:10.276388 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001934 Feb 21 02:19:10.276779 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Mon Feb 21 02:19:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:19:10.279174 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a23f7db9c0 pid: 102072 (default app) Feb 21 02:20:31.893818 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:31.895450 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Feb 21 02:20:31.896052 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:32.332637 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-831791fa-fde5-47ff-a24d-5bea193b030d admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:32.365712 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-831791fa-fde5-47ff-a24d-5bea193b030d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461631 Feb 21 02:20:32.365712 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1291 bytes} [Mon Feb 21 02:20:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:20:34.747629 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:34.748628 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-f6bbc4a8-942a-4a0f-a0e8-dfa137cb2d58 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Feb 21 02:20:34.749015 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:34.809998 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-7078869d-5910-4c98-837a-b9bc4cfdf2f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:34.828873 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:20:34.828873 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: warnings.warn(msg) Feb 21 02:20:34.858658 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-7078869d-5910-4c98-837a-b9bc4cfdf2f6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102955 Feb 21 02:20:34.860292 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:20:35.088536 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-b31be4e1-ba9f-4983-9d23-684bbd2728d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:35.091001 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:20:35.091001 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: warnings.warn(msg) Feb 21 02:20:35.141784 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-b31be4e1-ba9f-4983-9d23-684bbd2728d7 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.274449 Feb 21 02:20:35.142566 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1335 bytes} [Mon Feb 21 02:20:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:20:37.498259 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-7078869d-5910-4c98-837a-b9bc4cfdf2f6 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:37.500516 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-7078869d-5910-4c98-837a-b9bc4cfdf2f6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001684 Feb 21 02:20:37.501233 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:37.624796 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-3ee7405e-c8d8-42a0-a641-7bbef653fb77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:37.643614 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:20:37.643614 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: warnings.warn(msg) Feb 21 02:20:37.663422 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-3ee7405e-c8d8-42a0-a641-7bbef653fb77 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156190 Feb 21 02:20:37.664217 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:20:37.676977 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-d0cc8e84-718c-49da-b6c5-f9f7fee7e3dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:37.678489 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:20:37.678489 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: warnings.warn(msg) Feb 21 02:20:37.714370 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-d0cc8e84-718c-49da-b6c5-f9f7fee7e3dc admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041194 Feb 21 02:20:37.715400 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1335 bytes} [Mon Feb 21 02:20:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:20:40.095409 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-3ee7405e-c8d8-42a0-a641-7bbef653fb77 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:40.096411 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-3ee7405e-c8d8-42a0-a641-7bbef653fb77 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Feb 21 02:20:40.096807 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:40.158000 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-42bcf958-8e46-4c82-bf74-fd36f5fc46ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:40.176189 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-42bcf958-8e46-4c82-bf74-fd36f5fc46ed admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073418 Feb 21 02:20:40.176731 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:20:40.188720 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-ad9cceb6-f5b1-40af-ae0b-c15044918409 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:40.212847 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-ad9cceb6-f5b1-40af-ae0b-c15044918409 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028224 Feb 21 02:20:40.221905 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1335 bytes} [Mon Feb 21 02:20:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:20:42.582775 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-42bcf958-8e46-4c82-bf74-fd36f5fc46ed admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:42.584483 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-42bcf958-8e46-4c82-bf74-fd36f5fc46ed admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Feb 21 02:20:42.585475 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:42.643094 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-96deebe1-22d8-4506-a017-91c581ed22f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:42.662987 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-96deebe1-22d8-4506-a017-91c581ed22f5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071618 Feb 21 02:20:42.663528 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 02:20:42.675685 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-9fe730d7-3c4b-4d6a-9a77-e9efea524853 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:42.697240 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-9fe730d7-3c4b-4d6a-9a77-e9efea524853 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025129 Feb 21 02:20:42.697839 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1335 bytes} [Mon Feb 21 02:20:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:20:45.076747 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-96deebe1-22d8-4506-a017-91c581ed22f5 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:45.077784 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-96deebe1-22d8-4506-a017-91c581ed22f5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Feb 21 02:20:45.078184 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:45.136404 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-9f0987d6-4a85-4294-ae60-df27ceee8606 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "swap": 0, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:45.154820 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-9f0987d6-4a85-4294-ae60-df27ceee8606 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070361 Feb 21 02:20:45.157693 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 02:20:45.167083 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-1017f3ef-19ec-42f5-947b-60460ce0f226 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:45.190898 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-1017f3ef-19ec-42f5-947b-60460ce0f226 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027372 Feb 21 02:20:45.191711 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1335 bytes} [Mon Feb 21 02:20:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:20:47.571021 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-9f0987d6-4a85-4294-ae60-df27ceee8606 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:47.572026 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-9f0987d6-4a85-4294-ae60-df27ceee8606 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Feb 21 02:20:47.572447 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:47.631355 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-fb397864-b7b2-4610-bb2d-b7958f3a1d8b admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:47.655868 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-fb397864-b7b2-4610-bb2d-b7958f3a1d8b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076502 Feb 21 02:20:47.665999 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1291 bytes} [Mon Feb 21 02:20:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:20:50.015328 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-9f0987d6-4a85-4294-ae60-df27ceee8606 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:50.016398 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-9f0987d6-4a85-4294-ae60-df27ceee8606 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Feb 21 02:20:50.016904 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:50.081614 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-b65a1f8f-a70b-45c4-90d4-b785276d27c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "disk": 1, "id": "1"}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:50.101795 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-b65a1f8f-a70b-45c4-90d4-b785276d27c6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078982 Feb 21 02:20:50.102345 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:20:50.114545 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-2fc02ca3-3665-4308-b674-01ac797250f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:50.137599 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-2fc02ca3-3665-4308-b674-01ac797250f5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026659 Feb 21 02:20:50.138164 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1332 bytes} [Mon Feb 21 02:20:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:20:52.489616 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-b65a1f8f-a70b-45c4-90d4-b785276d27c6 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:52.490652 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-b65a1f8f-a70b-45c4-90d4-b785276d27c6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Feb 21 02:20:52.491035 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:52.552890 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-786df284-9dd5-493f-b981-20eb12506504 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:52.574295 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-786df284-9dd5-493f-b981-20eb12506504 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076998 Feb 21 02:20:52.575009 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:20:52.586900 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-ffd31389-f3b1-42d7-9725-9444c39721ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:52.612522 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-ffd31389-f3b1-42d7-9725-9444c39721ed admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028946 Feb 21 02:20:52.613276 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1332 bytes} [Mon Feb 21 02:20:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:20:54.976235 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-786df284-9dd5-493f-b981-20eb12506504 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:54.977248 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-786df284-9dd5-493f-b981-20eb12506504 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 21 02:20:54.977859 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:55.035041 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-6d35e43d-20fe-4237-ac71-2609ed32d86b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "ram": 4096, "id": "3", "swap": 0}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:55.052162 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-6d35e43d-20fe-4237-ac71-2609ed32d86b admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068476 Feb 21 02:20:55.052705 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:20:55.064498 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-ec8dd9dd-4493-4588-ac3f-57fba9a40563 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:55.088235 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-ec8dd9dd-4493-4588-ac3f-57fba9a40563 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027531 Feb 21 02:20:55.088813 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1332 bytes} [Mon Feb 21 02:20:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:20:57.452540 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-6d35e43d-20fe-4237-ac71-2609ed32d86b admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:57.453561 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-6d35e43d-20fe-4237-ac71-2609ed32d86b admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Feb 21 02:20:57.454177 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:20:57.516449 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-ebb81d3a-37b7-47b6-a872-94e0d69bbd2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4"}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:57.537288 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-ebb81d3a-37b7-47b6-a872-94e0d69bbd2a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077209 Feb 21 02:20:57.538191 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:20:57.550512 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-722ab9e8-e495-467c-a28a-ac83859e4177 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:20:57.578350 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-722ab9e8-e495-467c-a28a-ac83859e4177 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031346 Feb 21 02:20:57.578933 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1332 bytes} [Mon Feb 21 02:20:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:20:59.945922 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-ebb81d3a-37b7-47b6-a872-94e0d69bbd2a admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:20:59.947586 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-ebb81d3a-37b7-47b6-a872-94e0d69bbd2a admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Feb 21 02:20:59.947986 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:20:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:00.011528 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-7b007d71-17bc-441b-896f-fb1da807ae91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "vcpus": 8, "id": "5", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:21:00.030518 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-7b007d71-17bc-441b-896f-fb1da807ae91 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076054 Feb 21 02:21:00.031068 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1282 bytes} [Mon Feb 21 02:20:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 02:21:00.042570 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-b918b032-48df-44a9-93cc-b21a7989c4da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:21:00.070223 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-b918b032-48df-44a9-93cc-b21a7989c4da admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031086 Feb 21 02:21:00.070815 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1332 bytes} [Mon Feb 21 02:21:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:21:22.900316 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-7b007d71-17bc-441b-896f-fb1da807ae91 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:22.901319 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-7b007d71-17bc-441b-896f-fb1da807ae91 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Feb 21 02:21:22.901748 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:21:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:22.957838 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-140bc4b6-3754-4bfb-bc3d-70662c46d72e admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:22.974842 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-140bc4b6-3754-4bfb-bc3d-70662c46d72e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067190 Feb 21 02:21:22.975378 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1291 bytes} [Mon Feb 21 02:21:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:21:24.385881 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-7b007d71-17bc-441b-896f-fb1da807ae91 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:24.386913 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-7b007d71-17bc-441b-896f-fb1da807ae91 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 21 02:21:24.387316 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:21:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:24.596506 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-edcf5901-8acc-4b7f-b263-a6b1cb3c69c6 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:24.601842 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.wsgi [None req-edcf5901-8acc-4b7f-b263-a6b1cb3c69c6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 02:21:24.602431 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-edcf5901-8acc-4b7f-b263-a6b1cb3c69c6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:21:24.603210 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-edcf5901-8acc-4b7f-b263-a6b1cb3c69c6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056768 Feb 21 02:21:24.603978 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Mon Feb 21 02:21:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 02:21:24.613758 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-1561293b-9296-4030-9950-248717c75ae7 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:24.633596 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-1561293b-9296-4030-9950-248717c75ae7 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023274 Feb 21 02:21:24.634147 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Feb 21 02:21:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:21:24.643470 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-a91fb1f8-9a6f-4173-974c-1883b005615a admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:24.664800 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-a91fb1f8-9a6f-4173-974c-1883b005615a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024765 Feb 21 02:21:24.665324 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Feb 21 02:21:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:21:24.675177 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-41a74fce-4bda-4376-9195-30b0ade81bd8 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:24.680461 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.wsgi [None req-41a74fce-4bda-4376-9195-30b0ade81bd8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 02:21:24.681026 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-41a74fce-4bda-4376-9195-30b0ade81bd8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:21:24.681843 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-41a74fce-4bda-4376-9195-30b0ade81bd8 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010110 Feb 21 02:21:24.682328 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Mon Feb 21 02:21:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 02:21:25.943919 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-a91fb1f8-9a6f-4173-974c-1883b005615a admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:25.944917 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-a91fb1f8-9a6f-4173-974c-1883b005615a admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Feb 21 02:21:25.945314 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:26.133037 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-2cbb25c5-5959-4d6d-a7fd-4ad00b0be3b3 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:26.138668 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.wsgi [None req-2cbb25c5-5959-4d6d-a7fd-4ad00b0be3b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 02:21:26.139239 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-2cbb25c5-5959-4d6d-a7fd-4ad00b0be3b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:21:26.140024 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-2cbb25c5-5959-4d6d-a7fd-4ad00b0be3b3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057500 Feb 21 02:21:26.140517 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Mon Feb 21 02:21:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 02:21:26.149842 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-b460a804-8790-44df-ae73-5207d6fef200 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:26.163910 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-b460a804-8790-44df-ae73-5207d6fef200 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017522 Feb 21 02:21:26.164371 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Feb 21 02:21:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:21:26.173809 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-62549fdc-9b1b-43ef-94b0-dc17f6859bc1 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:26.186860 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-62549fdc-9b1b-43ef-94b0-dc17f6859bc1 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016358 Feb 21 02:21:26.187374 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Feb 21 02:21:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:21:26.196153 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-4f840b8e-7bb4-4bc8-ad2f-6aafb4b329eb admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:26.201418 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.wsgi [None req-4f840b8e-7bb4-4bc8-ad2f-6aafb4b329eb admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 02:21:26.202020 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-4f840b8e-7bb4-4bc8-ad2f-6aafb4b329eb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:21:26.202796 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-4f840b8e-7bb4-4bc8-ad2f-6aafb4b329eb admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010035 Feb 21 02:21:26.203312 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Mon Feb 21 02:21:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 02:21:27.470538 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-62549fdc-9b1b-43ef-94b0-dc17f6859bc1 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:27.471537 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-62549fdc-9b1b-43ef-94b0-dc17f6859bc1 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Feb 21 02:21:27.471934 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:27.661758 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-ac374c10-1111-4a6c-a893-c76e719261de admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:27.666966 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.wsgi [None req-ac374c10-1111-4a6c-a893-c76e719261de admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 02:21:27.667517 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-ac374c10-1111-4a6c-a893-c76e719261de admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:21:27.668331 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-ac374c10-1111-4a6c-a893-c76e719261de admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056611 Feb 21 02:21:27.668857 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Feb 21 02:21:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 02:21:27.678804 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-effc87ea-cb07-4048-93e7-b3db0a99102e admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:27.692307 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-effc87ea-cb07-4048-93e7-b3db0a99102e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017022 Feb 21 02:21:27.692823 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Feb 21 02:21:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:21:27.703524 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:27.716721 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017656 Feb 21 02:21:27.717278 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Mon Feb 21 02:21:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:21:27.726130 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-5bf24df8-6f9c-4535-ab5a-63125ed33ad7 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:27.732205 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.wsgi [None req-5bf24df8-6f9c-4535-ab5a-63125ed33ad7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 02:21:27.733010 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-5bf24df8-6f9c-4535-ab5a-63125ed33ad7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:21:27.733835 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-5bf24df8-6f9c-4535-ab5a-63125ed33ad7 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011092 Feb 21 02:21:27.734319 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Feb 21 02:21:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 02:21:28.994869 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:28.995863 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Feb 21 02:21:28.996254 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:29.189078 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-016dbaa4-896b-41f4-acba-3f58f8075f06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:21:29.208121 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-016dbaa4-896b-41f4-acba-3f58f8075f06 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068665 Feb 21 02:21:29.208654 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Mon Feb 21 02:21:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:21:30.490187 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:30.491183 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Feb 21 02:21:30.491578 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:30.678462 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-f0c3a14f-4e44-4a33-bd83-52152f792af5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:21:30.695974 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-f0c3a14f-4e44-4a33-bd83-52152f792af5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067600 Feb 21 02:21:30.696530 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Mon Feb 21 02:21:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:21:31.969295 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:31.970379 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Feb 21 02:21:31.970766 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:32.157852 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-04a0fb03-654d-4030-b3a9-d8f78a34a817 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:21:32.178288 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-04a0fb03-654d-4030-b3a9-d8f78a34a817 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069490 Feb 21 02:21:32.178788 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Mon Feb 21 02:21:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:21:33.473921 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:33.474931 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Feb 21 02:21:33.475324 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:33.668058 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-1f9948e6-0137-4fea-ab0e-68ff6497c0ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:21:33.685792 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-1f9948e6-0137-4fea-ab0e-68ff6497c0ea admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067636 Feb 21 02:21:33.686334 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Mon Feb 21 02:21:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:21:34.948333 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:34.949319 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Feb 21 02:21:34.949725 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:21:35.139549 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-accf7808-b2df-4a9a-966b-3d2d4e82487a admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:21:35.159201 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-accf7808-b2df-4a9a-966b-3d2d4e82487a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070070 Feb 21 02:21:35.159669 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Mon Feb 21 02:21:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:22:25.744706 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:22:25.746306 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-74fe5c27-9d05-4202-897f-eaf0d074b020 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002355 Feb 21 02:22:25.747164 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 930 bytes} [Mon Feb 21 02:22:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:22:25.803411 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-8902b496-6f54-486a-ba4e-8bafe8d2f187 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:22:25.822305 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-8902b496-6f54-486a-ba4e-8bafe8d2f187 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068997 Feb 21 02:22:25.822833 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1291 bytes} [Mon Feb 21 02:22:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:22:25.845233 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-6b1298be-94e5-4517-91ab-362526b81229 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:22:25.852716 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-6b1298be-94e5-4517-91ab-362526b81229 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010996 Feb 21 02:22:25.853225 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1282 bytes} [Mon Feb 21 02:22:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:22:25.864545 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-a255e8dc-7125-45f7-8804-8d56fdc5318e admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:22:25.872124 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-a255e8dc-7125-45f7-8804-8d56fdc5318e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010954 Feb 21 02:22:25.872622 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1285 bytes} [Mon Feb 21 02:22:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:22:25.883329 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-ebbec21d-6e6c-4649-8d73-6c96b63544b6 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:22:25.891592 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-ebbec21d-6e6c-4649-8d73-6c96b63544b6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011642 Feb 21 02:22:25.892098 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1285 bytes} [Mon Feb 21 02:22:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:22:25.902747 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:22:25.911980 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012585 Feb 21 02:22:25.912508 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1282 bytes} [Mon Feb 21 02:22:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:23:58.759782 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-0533c7e6-c7cd-4b41-9779-42e7d57f9920 tempest-verify_tempest_config-1243968964 tempest-verify_tempest_config-1243968964-project] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:23:58.762351 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-0533c7e6-c7cd-4b41-9779-42e7d57f9920 tempest-verify_tempest_config-1243968964 tempest-verify_tempest_config-1243968964-project] 10.222.0.75 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105672 Feb 21 02:23:58.762882 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 34/69] 10.222.0.75 () {58 vars in 1133 bytes} [Mon Feb 21 02:23:58 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:25:32.167834 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:25:32.169203 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Feb 21 02:25:32.169566 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 36/70] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:25:32.422129 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-503935e3-e3e6-401b-915d-3b04d5bdacee admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:25:32.423314 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:25:32.423314 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: warnings.warn(msg) Feb 21 02:25:32.425139 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-503935e3-e3e6-401b-915d-3b04d5bdacee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:25:32.425578 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-503935e3-e3e6-401b-915d-3b04d5bdacee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:25:32.426394 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-503935e3-e3e6-401b-915d-3b04d5bdacee admin admin] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:25:32.426814 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-503935e3-e3e6-401b-915d-3b04d5bdacee admin admin] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:25:32.459723 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-503935e3-e3e6-401b-915d-3b04d5bdacee admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148202 Feb 21 02:25:32.460303 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 35/71] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Feb 21 02:25:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:25:33.756178 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:25:33.757227 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Feb 21 02:25:33.757884 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 37/72] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:25:33.949536 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-91c60720-e893-43f2-ba76-fbfcdf3782ea admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:25:33.950715 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:25:33.950715 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: warnings.warn(msg) Feb 21 02:25:33.952861 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-91c60720-e893-43f2-ba76-fbfcdf3782ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:25:33.953296 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-91c60720-e893-43f2-ba76-fbfcdf3782ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:25:33.954190 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-91c60720-e893-43f2-ba76-fbfcdf3782ea admin admin] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:25:33.954610 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-91c60720-e893-43f2-ba76-fbfcdf3782ea admin admin] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:25:33.972948 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-91c60720-e893-43f2-ba76-fbfcdf3782ea admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074636 Feb 21 02:25:33.973846 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 36/73] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Feb 21 02:25:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 02:25:45.691312 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:25:45.692297 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Feb 21 02:25:45.692681 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 38/74] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:25:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:25:45.882319 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-43ceade8-2fa3-4e4e-9915-86fefebbec49 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:25:45.883473 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:25:45.883473 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: warnings.warn(msg) Feb 21 02:25:45.885577 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-43ceade8-2fa3-4e4e-9915-86fefebbec49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:25:45.886034 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-43ceade8-2fa3-4e4e-9915-86fefebbec49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:25:45.886822 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-43ceade8-2fa3-4e4e-9915-86fefebbec49 admin admin] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:25:45.887245 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-43ceade8-2fa3-4e4e-9915-86fefebbec49 admin admin] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:25:45.911088 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-43ceade8-2fa3-4e4e-9915-86fefebbec49 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079287 Feb 21 02:25:45.911564 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 37/75] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Feb 21 02:25:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:25:47.200461 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: DEBUG nova.api.openstack.wsgi [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] Calling method '>' {{(pid=102071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:25:47.201507 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: INFO nova.api.openstack.requestlog [None req-2fc0a111-f029-4bfa-b9b8-38fa73db0426 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Feb 21 02:25:47.201952 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: [pid: 102071|app: 0|req: 39/76] 10.222.0.75 () {56 vars in 1074 bytes} [Mon Feb 21 02:25:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:25:47.422404 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG nova.api.openstack.wsgi [None req-f1eb59dd-8f1a-4d41-a1fa-533069cbdd81 admin admin] Calling method '>' {{(pid=102072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:25:47.423591 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:25:47.423591 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: warnings.warn(msg) Feb 21 02:25:47.425158 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-f1eb59dd-8f1a-4d41-a1fa-533069cbdd81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:25:47.425626 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-f1eb59dd-8f1a-4d41-a1fa-533069cbdd81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:25:47.426455 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-f1eb59dd-8f1a-4d41-a1fa-533069cbdd81 admin admin] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:25:47.426866 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: DEBUG oslo_concurrency.lockutils [None req-f1eb59dd-8f1a-4d41-a1fa-533069cbdd81 admin admin] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:25:47.448263 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: INFO nova.api.openstack.requestlog [None req-f1eb59dd-8f1a-4d41-a1fa-533069cbdd81 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077103 Feb 21 02:25:47.448804 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: [pid: 102072|app: 0|req: 38/77] 10.222.0.75 () {60 vars in 1193 bytes} [Mon Feb 21 02:25:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:26:44.048968 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: Mon Feb 21 02:26:44 2022 - graceful shutdown triggered... Feb 21 02:26:44.049486 dv-cinder-804470-8-iscsi devstack@n-api.service[102071]: Gracefully killing worker 1 (pid: 102071)... Feb 21 02:26:44.049090 dv-cinder-804470-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 21 02:26:44.053483 dv-cinder-804470-8-iscsi devstack@n-api.service[102072]: Gracefully killing worker 2 (pid: 102072)... Feb 21 02:26:45.049746 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: worker 1 buried after 1 seconds Feb 21 02:26:45.049746 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: worker 2 buried after 1 seconds Feb 21 02:26:45.049746 dv-cinder-804470-8-iscsi devstack@n-api.service[102070]: goodbye to uWSGI. Feb 21 02:26:45.051250 dv-cinder-804470-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 21 02:26:45.051800 dv-cinder-804470-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 21 02:26:45.054499 dv-cinder-804470-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 02:26:45.071675 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 02:26:45 2022] *** Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: nodename: dv-cinder-804470-8-iscsi Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: machine: x86_64 Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: clock source: unix Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: pcre jit disabled Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: detected number of CPU cores: 4 Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: current working directory: / Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: detected binary path: /usr/bin/uwsgi-core Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: your processes number limit is 47680 Feb 21 02:26:45.102497 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: your memory page size is 4096 bytes Feb 21 02:26:45.103383 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: detected max file descriptor number: 2048 Feb 21 02:26:45.103383 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: lock engine: pthread robust mutexes Feb 21 02:26:45.103383 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: thunder lock: enabled Feb 21 02:26:45.103383 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 02:26:45.103383 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 02:26:45.149253 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: Python main interpreter initialized at 0x55cf9f0f99c0 Feb 21 02:26:45.149253 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: python threads support enabled Feb 21 02:26:45.149253 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: your server socket listen backlog is limited to 100 connections Feb 21 02:26:45.149253 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: your mercy for graceful operations on workers is 90 seconds Feb 21 02:26:45.149825 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 02:26:45.149825 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: *** Operational MODE: preforking *** Feb 21 02:26:45.150002 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: *** uWSGI is running in multiple interpreter mode *** Feb 21 02:26:45.150002 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: spawned uWSGI master process (pid: 116695) Feb 21 02:26:45.150835 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: spawned uWSGI worker 1 (pid: 116710, cores: 1) Feb 21 02:26:45.151040 dv-cinder-804470-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 02:26:45.151230 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: spawned uWSGI worker 2 (pid: 116711, cores: 1) Feb 21 02:26:45.152354 dv-cinder-804470-8-iscsi devstack@n-api.service[116695]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 02:26:47.079628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 02:26:47.079628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: from cryptography.utils import int_from_bytes Feb 21 02:26:47.080303 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 02:26:47.080303 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: from cryptography.utils import int_from_bytes Feb 21 02:26:47.103642 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 02:26:47.103642 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: from cryptography.utils import int_from_bytes Feb 21 02:26:47.104159 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 02:26:47.104159 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: from cryptography.utils import int_from_bytes Feb 21 02:26:49.495228 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 02:26:49.495792 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 02:26:49.496063 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 02:26:49.496281 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 02:26:49.496548 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 02:26:49.496944 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.497452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.497965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.498312 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.498724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.498982 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.499315 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.499645 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.499988 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.500256 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.500582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.500923 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804470-8-iscsi {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.501262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.501580 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.501932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.502260 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.502574 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.502907 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.503231 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.503745 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.505133 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.505133 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.505133 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.505133 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.505462 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.505792 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.506124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.506443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.507347 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.507772 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.508367 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804470-8-iscsi {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.508691 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.509015 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.509342 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.509830 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.510134 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.510451 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.510783 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.511131 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.511452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.511804 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.512122 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.512452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.512785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.513099 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.513417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.513766 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.514096 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.514413 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.514726 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.514985 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.515302 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.515632 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.515963 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.516295 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.516554 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.516810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.517138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.517331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 02:26:49.517846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.518007 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 02:26:49.518157 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.518157 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.518452 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 02:26:49.518605 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.518757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 02:26:49.518757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 02:26:49.519044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.519044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.519322 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.519485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.519627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.519775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.519917 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.520068 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.520235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.520416 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.520593 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.520744 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.520895 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.521042 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.521212 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.521354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.521525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.521787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.521937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.521937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.522224 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.522376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.522533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.522533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.522805 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804470-8-iscsi {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.523009 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.523180 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.523330 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.523485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.523637 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.523807 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.523961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.524113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.524264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.524425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.524565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.524712 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.524862 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.525004 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.525160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.525327 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.525467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.525631 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.525797 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.525954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.526635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.526793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.526935 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.527103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.527257 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.527414 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.527555 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.527701 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.527853 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.528062 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.528221 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.528376 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.528524 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.528683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.528823 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.528969 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.529124 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.529264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.529410 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804470-8-iscsi {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.529558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.529715 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.529880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.530021 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.530169 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.530323 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.530463 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.530463 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.530748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.530899 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.531039 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.531179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.531318 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.531463 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.531617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.531757 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.531896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.532042 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.532202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.532361 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.532515 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.532661 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.532810 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.532950 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.533089 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.533238 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.533433 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.533720 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.533880 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.534030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.534182 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.534334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.534489 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.534637 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.534786 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.534926 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.535066 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.535205 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.535352 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.535493 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.535665 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.535914 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.536074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.536819 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.536971 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.537131 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.537287 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.537440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.537588 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.537588 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.538327 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.538491 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.538641 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.538789 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.538938 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.539088 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.539248 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.539399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.539541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.539680 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.539818 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.539964 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.540179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.540321 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.540459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.540600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.540738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.540979 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.541134 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.541287 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.541434 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.541583 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.541772 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.541922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.542071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.542229 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.542378 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.542518 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.542657 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.542807 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.542958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.543099 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.543249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.543249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.543520 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.543520 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.543809 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.543996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.544150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.544298 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.544438 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.544594 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.544734 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.544884 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.545042 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.545190 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.545365 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.545515 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.545684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.545843 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.545984 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.546130 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.546269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.546930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.547186 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.547335 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.547474 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.547625 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.547774 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.547916 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.548063 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.548228 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.548445 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.548590 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.548748 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.548896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.548896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.549168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.549315 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.549460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.549627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.549834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.549986 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.550135 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.550284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.550431 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.550581 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.550720 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.550866 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.551006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.551146 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.551299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.551440 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.551590 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.552421 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.552615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.552758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.552960 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.553131 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.553338 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.554446 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.554612 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.555198 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.555408 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.555577 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.555738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.555881 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.556027 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.556176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.556176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.556460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.557207 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.557459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.557620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.557785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.557938 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.558100 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.558360 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.558600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.558761 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.558911 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.559052 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.559191 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.559331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.559478 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.559632 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.559780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.559921 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.560060 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.560210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.560357 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.560512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.560660 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.560801 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.560939 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.561078 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.561217 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.561365 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.561513 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.561728 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.561885 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.562034 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.562194 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.562335 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.562491 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.562641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.562798 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.562947 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.563087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.563226 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.563384 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.563526 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.563676 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.563816 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.563957 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.564124 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.564124 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.564406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.564406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.564673 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.564673 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.565017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.565160 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.565299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.565705 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.565866 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.566008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.566158 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.566318 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 02:26:49.566468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.566608 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.567719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.567719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.567915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568092 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568177 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568268 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568363 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568519 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568696 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568772 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568852 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.568962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.569063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.569212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.569830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.569932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570186 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570365 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570634 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570712 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570803 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570889 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.570973 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571060 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571261 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571346 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571438 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571438 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571605 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571605 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571865 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.571949 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572130 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572216 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572308 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572392 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572573 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572573 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572735 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572819 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572902 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.572992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573090 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573183 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573357 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573520 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573720 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573812 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573884 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.573966 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574060 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574146 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574232 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574315 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574398 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574488 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574585 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574682 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574774 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574869 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.574961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575054 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575377 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575709 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.575877 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.576045 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.576156 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.576329 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.576423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.576643 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.576744 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.576967 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.577173 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.577376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.577557 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.578249 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.578422 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.578583 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.578757 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.578998 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.579166 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.579323 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.579471 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.579618 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.579771 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.579926 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.580086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.580317 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.580468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.580614 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.580787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.580977 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.581228 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.581387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.581544 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.581752 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.581907 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.582063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.582225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.582478 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.582639 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.582816 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.582968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.583180 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.583336 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.583566 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.583838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.584015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.584168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.584334 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.584481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.584635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.584857 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.585007 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.585154 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.585317 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.585465 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.585611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.585795 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.585943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.586151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.586309 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.586464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.586629 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.586777 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.586923 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.587108 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.587255 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.587410 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.587556 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.587711 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.588086 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.588605 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.588924 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.589342 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.589502 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.589751 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.589909 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.590076 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.590225 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.590421 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.590573 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.590719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.590888 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.591051 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.591201 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.591354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.591501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.591654 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.591815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.591971 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.592125 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.592347 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.592563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.592720 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.592965 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.593269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.593423 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.593576 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.593749 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.593907 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.594066 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.594215 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.594360 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.594647 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.594797 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.594989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.595152 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.595308 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.595474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.595621 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.595766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.595766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.596065 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.596065 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.596587 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.596818 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.597004 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.597004 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.597307 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.597461 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.597619 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.597800 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.597965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.598289 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.598550 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.598868 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.599021 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.599175 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.599456 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.599705 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.599863 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.600018 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.600172 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.600358 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.600513 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.600669 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.600824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.601118 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.601360 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.601525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.601725 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.601888 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.602045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.602192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.602345 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.602493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.602668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.602815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.602961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.603193 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.603353 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.603501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.603661 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.603809 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.603961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.604107 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.604252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.604404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.604560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.604718 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.604872 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.605019 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.605164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.605317 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.605464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.605610 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.605782 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.605929 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.606074 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.606236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.606391 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.606547 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.606717 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.606865 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.607018 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.607174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.607329 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.607489 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.607640 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.607786 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.607949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.608925 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609043 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609124 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609279 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609363 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609578 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609682 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609864 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.609938 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610016 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610088 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610294 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610374 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610453 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610531 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610681 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610761 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610833 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.610983 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611141 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611222 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611295 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611364 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611443 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611610 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611681 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611749 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611825 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611906 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.611985 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612056 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612201 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612281 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612353 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612436 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612516 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612594 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612665 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612742 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612891 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.612962 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613106 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613191 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613370 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613460 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613609 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.613931 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614017 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614097 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614259 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614329 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614486 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614557 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614625 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.614974 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.615079 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.615202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.615401 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.615501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.615725 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.615844 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.616566 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.616680 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.616885 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.617056 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.617202 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.617335 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.617521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.617625 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.617862 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.617968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.618174 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.618269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.618487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.618620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.618800 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.618970 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.619113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.619204 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.619423 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.619529 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.619740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.619829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.620053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.620144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.620366 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.620457 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.620677 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.620775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.620984 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.621088 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.621291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.621383 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.621599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.621724 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.621946 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.622038 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.622256 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.622345 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.622565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.622670 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.622874 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.622964 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.623179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.623270 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.623489 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.623594 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.623800 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.623977 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.624214 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.624399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.624559 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.624719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.624886 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.625035 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.625262 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.625444 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.625688 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.625846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.625992 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.625992 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.626283 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.627675 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.627675 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.628017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.628170 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.628333 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.628858 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.629090 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.629264 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.629264 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.629804 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.629965 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.630130 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.630278 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.630424 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.630570 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.630723 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.630902 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.631050 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.631195 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.631340 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.631566 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.632335 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.632549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.632707 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.632856 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.633002 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.633148 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.633301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.633457 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.633750 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.633910 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.634056 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.634202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.634202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.634556 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.634706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.634706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.635079 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.635264 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.635476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.635718 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.635934 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.636111 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.636266 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.636420 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.636577 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.636742 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.636889 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.637056 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.637761 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.637876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.637976 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638214 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638362 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638679 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638837 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.638995 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639134 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639289 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639370 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639678 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639750 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639852 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.639934 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640140 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640213 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640290 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640363 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640455 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640527 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640602 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640832 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.640914 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.641225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.641317 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.641396 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.641511 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.641700 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.641857 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.641999 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.642163 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.642321 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.642468 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.642648 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.642796 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.642977 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.643115 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.643312 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.643465 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.643647 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.643806 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.643939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.644058 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.644256 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.644355 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.644562 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.644698 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.644871 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.645006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.645177 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.645321 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.645478 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.645580 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.645824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.645937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.646128 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.646221 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.646435 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.646528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.646745 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.646838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.647049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.647151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.647411 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.647518 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.647784 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.647999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.648092 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.648227 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.648354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.648553 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.648688 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.648860 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.649003 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.649172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.649310 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.649477 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.649616 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.649826 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.649952 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.650100 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.650272 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.650397 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.650606 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.650713 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.650996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.651086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.651300 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.651401 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.651604 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.651705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.651927 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.652109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.652240 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.652335 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.652549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.652661 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.652851 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.652988 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.653155 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.653260 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.653458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.653560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.653837 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.654004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.654147 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.654328 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.654509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.654645 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.654815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.654963 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.655132 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.655276 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.655454 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.655588 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.655766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.655906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.656075 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.656240 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.656390 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.656553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.656695 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.656890 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.657010 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.657203 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.657307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.657533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.657627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.657869 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.657976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.658200 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.658293 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.658548 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.658638 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.658859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.658966 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.659170 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.659266 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.659494 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.659649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.659816 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.659964 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.660141 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.660270 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.660447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.660601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.660758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.660932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.661068 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.661264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.661377 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.661576 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.661712 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.661925 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.662034 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.662242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.662356 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.662573 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.662678 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.663554 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.663776 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.663868 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.663962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.664049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.664185 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.664335 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.664507 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.664632 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.664843 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.664953 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.665178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.665276 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.665543 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.665667 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.665876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.665990 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.666187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.666389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.666482 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.666724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.666817 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.667042 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.667143 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.667372 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.667464 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.667707 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.667798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.668021 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.668115 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.668335 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.668434 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.668654 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.668753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.668967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.669068 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.669280 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.669384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.669595 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.669725 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.669939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.670039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.670245 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.670347 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.670565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.670676 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.670884 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.670978 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.671196 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.671342 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.671507 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.671609 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.671838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.671938 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.672140 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.672258 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.672450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.672554 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.672778 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.672868 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.673080 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.673179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.673387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.673486 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.673717 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.673831 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.674044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.674163 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.674351 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.674458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.674669 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.674769 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.674982 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.675084 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.675294 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.675385 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.675646 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.675738 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.675960 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.676067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.676285 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.676384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.676624 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.676716 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.676962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.677064 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.677289 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.677402 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.677600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.677715 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.677932 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.678027 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.678248 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.678348 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.678627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.679226 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.679460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.679552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.679785 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.679886 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.680099 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.680190 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.680414 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.680507 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.680721 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.680821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.681049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.681157 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.681368 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.681467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.681701 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.681807 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.682031 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.682141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.682339 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.682479 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.682651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.682775 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.682982 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.683084 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.683316 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.683415 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.683648 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.683740 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.684057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.684167 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.684263 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.684349 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.684563 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.684656 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.684872 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.684980 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.685176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.685269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.685499 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.685601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.685832 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.685935 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.686148 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.686247 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.686462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.686564 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.686773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.686874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.687078 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.687171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.687383 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.687486 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.687706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.687805 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.688009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.688108 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.688334 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.688448 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.688649 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.688768 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.688967 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.689060 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.689291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.689400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.689601 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.689751 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.689954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.690057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.690263 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.690407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.690567 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.690699 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.690872 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.690967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.691176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.691444 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.691546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.691780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.691880 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.692103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.692210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.692424 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.692561 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.692752 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.692851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.693062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.693171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.693381 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.693476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.693731 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.693829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.694053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.694212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.694430 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.694603 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.694754 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.694932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.695055 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.695275 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.695369 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.695609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.695703 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.695936 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.696045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.696241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.696342 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.696548 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.696651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.696890 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.697058 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.697274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.697404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.697576 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.697735 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.697908 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.698011 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.698232 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.698405 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.698607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.698732 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.698859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.698962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.699148 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.699250 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.699453 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.699565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.699759 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.699877 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.700064 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.700198 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.700409 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.700511 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.700714 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.700818 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.701049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.701143 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.701365 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.701473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.701709 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.701820 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.702041 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.702134 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.702351 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.702458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.702675 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.702777 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.702992 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.703087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.703307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.703409 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.703621 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.703725 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.703937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.704038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.704254 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.704489 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.704591 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.704813 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.704940 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.705159 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.705343 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.705474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.705581 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.705810 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.705905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.706128 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.706235 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.706490 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.706672 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.706828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.707001 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.707145 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.707315 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.707458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.707626 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.707779 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.707937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.708097 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.708250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.708411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.708562 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.708740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.708873 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.709059 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.709189 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.709371 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.709500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.709779 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.709996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.710143 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.710242 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.710572 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.710673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.710904 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.711007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.711243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.711336 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.711562 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.711657 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.711879 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.711989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.712195 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.712301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.712512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.712606 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.712872 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.712977 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.713186 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.713286 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.713491 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.713589 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.713832 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.713943 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.714149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.714243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.714485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.714581 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.714763 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.714865 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.715073 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.715184 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.715389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.715503 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.715699 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.715793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.716012 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.716109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.716320 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.716429 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.716634 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.716728 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.717074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.717182 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.717269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.717364 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.717554 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.717678 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.717898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.718004 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.718211 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.718305 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.718524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.718625 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.718839 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.718931 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.719149 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.719365 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.719479 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.719687 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.719788 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.720025 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.720133 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.720356 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.720464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.720686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.720787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.720999 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.721102 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.721317 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.721419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.721677 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.721774 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.721980 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.722088 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.722288 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.722382 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.722601 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.722696 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.722912 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.723007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.723218 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.723311 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.723541 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.723635 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.723853 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.723985 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.724160 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.724264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.724485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.724610 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.724797 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.724908 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.725851 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.725960 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.726229 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.726372 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.726551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.726645 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.726884 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.726992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.727215 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.727319 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.727529 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.727630 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.727837 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.727929 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.728149 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.728252 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.728462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.728555 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.728770 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.728871 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.729088 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.729192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.729402 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.729496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.729743 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.729878 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.730054 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.730149 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.730367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.730476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.730679 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.730772 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.730985 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.731080 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.731296 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.731388 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.731600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.731702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.731916 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.732010 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.732219 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.732310 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.732525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.732627 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.732830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.732925 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.733141 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.733245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.733444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.733553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.734024 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.734136 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.734335 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.734457 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.734692 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.734811 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.734946 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.735082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.735253 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.735406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.735564 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.735730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.735869 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.736069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.736164 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.736392 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.736500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.736708 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.736803 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.737105 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.737197 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.737433 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.737536 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.737764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.737902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.738074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.738168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.738391 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.738499 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.738704 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.738798 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.739026 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.739119 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.739338 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.739441 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.739659 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.739760 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.740004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.740104 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.740320 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.740422 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.740677 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.740850 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.741113 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.741786 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.742006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.742153 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.742331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.742427 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.742649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.742782 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.742967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.743072 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.743288 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.743395 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.743605 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.743777 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.743932 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.744040 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.744249 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.744344 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.744561 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.744665 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.744874 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.745009 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.745187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.745356 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.745500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.745601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.745841 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.745938 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.746155 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.746249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.746467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.746575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.746780 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.746874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.747094 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.747196 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.747407 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.747503 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.747723 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.747816 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.748044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.748137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.748365 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.748468 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.748680 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.748773 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.748996 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.749089 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.749312 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.749412 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.749632 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.749786 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.749966 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.750075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.750280 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.750428 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.750593 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.750694 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.750910 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.751013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.751241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.751338 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.751556 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.751651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.751864 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.751971 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.752201 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.752301 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.752523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.752617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.752847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.752942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.753168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.753269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.753488 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.753595 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.753840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.753993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.754166 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.754269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.754478 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.754573 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.754798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.754931 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.755111 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.755212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.755442 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.755603 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.755780 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.755882 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.756109 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.756211 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.756436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.756548 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.756790 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.756969 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.757098 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.757354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.757455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.757705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.757822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.758028 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.758168 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.758272 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 02:26:49.758368 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.758677 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.759003 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.759316 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.759646 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.759959 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.760282 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.760605 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.760922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.761233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.761566 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.761905 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.762218 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.762529 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.762839 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.763151 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.763461 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.763789 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.764117 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.764425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.764752 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.765073 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.765396 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.765734 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.766051 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.766384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.766695 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.767010 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.767326 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.767638 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.767948 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.768266 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.768582 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.768911 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.769236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.769568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.769921 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.770268 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.770585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.770930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.771260 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.771576 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.771889 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.772210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 02:26:49.772463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116710) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 02:26:49.781023 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:26:49.795197 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_db.sqlalchemy.engines [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116710) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:26:49.846393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.context [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33d1b4dd-d433-46ca-94fc-ac9f89dc5606(cell1) {{(pid=116711) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 02:26:49.851208 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:26:49.852807 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:26:49.853663 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:26:49.855610 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:26:49.859099 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.context [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33d1b4dd-d433-46ca-94fc-ac9f89dc5606(cell1) {{(pid=116710) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 02:26:49.863306 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:26:49.864899 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:26:49.865748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:26:49.868358 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:26:49.868541 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:26:49.869207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:26:49.878829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_db.sqlalchemy.engines [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116710) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:26:49.881109 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_db.sqlalchemy.engines [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116710) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:26:50.028328 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:26:50.039880 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_db.sqlalchemy.engines [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116710) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 02:26:50.362924 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: WARNING keystonemiddleware.auth_token [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 02:26:50.369951 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: WARNING keystonemiddleware.auth_token [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 02:26:50.383894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: WARNING keystonemiddleware.auth_token [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 02:26:50.390980 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: WARNING keystonemiddleware.auth_token [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 02:26:50.720169 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: WARNING keystonemiddleware.auth_token [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 02:26:50.725430 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: WARNING keystonemiddleware.auth_token [None req-d3245863-954f-40c1-ac28-eddf9695e1fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 02:26:50.731201 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cf9f0f99c0 pid: 116711 (default app) Feb 21 02:26:50.740074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: WARNING keystonemiddleware.auth_token [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 02:26:50.747566 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: WARNING keystonemiddleware.auth_token [None req-988b647c-f341-40eb-9934-42b5f32b0953 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 02:26:50.754737 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cf9f0f99c0 pid: 116710 (default app) Feb 21 02:27:28.013584 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d9aaa2ff-71c6-4d66-8e76-44e09809a2da tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Action: 'create', calling method: .version_select at 0x7fd85d78d0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-654707651", "metadata": {"Type": "work"}}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:28.847645 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-552a8244-ee4c-4b94-90f8-c1f00b66c144 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Action: 'create', calling method: .version_select at 0x7fd85d78d0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-751881865"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:30.310076 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d9aaa2ff-71c6-4d66-8e76-44e09809a2da tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.634976 Feb 21 02:27:30.311402 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1155 bytes} [Mon Feb 21 02:27:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3638 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 21 02:27:30.513270 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1017616677", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "d4d7fbe4-b74f-4889-adca-b065ca5bd2cf"}]}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:30.736955 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] validate_networks() for [('d4d7fbe4-b74f-4889-adca-b065ca5bd2cf', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:27:30.884450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-552a8244-ee4c-4b94-90f8-c1f00b66c144 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.806757 Feb 21 02:27:30.886203 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 1/2] 10.222.0.75 () {60 vars in 1154 bytes} [Mon Feb 21 02:27:27 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3810 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 21 02:27:31.138770 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-383789399", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "b9ab8591-8577-4435-b82e-00c6ea275be2"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:31.247312 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] validate_networks() for [('b9ab8591-8577-4435-b82e-00c6ea275be2', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:27:31.975107 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:27:31.976419 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:27:31.977115 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:27:31.978021 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:27:31.978538 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:27:31.999595 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:32.000349 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:32.003498 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:32.004354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:32.047618 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Getting quotas for project 440cb05903bb427baa54dbe25b56ee7c. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:27:32.057925 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Getting quotas for user 533f0f53f5504f0caec419a41f0f7452 and project 440cb05903bb427baa54dbe25b56ee7c. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:27:32.071535 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:27:32.074706 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:27:32.197362 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1bf43a00-3fc5-4365-a071-af7bbdd14c95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875218 Feb 21 02:27:32.198353 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 2/3] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:27:32.215876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-069590e6-c404-4167-b66e-005b4dd5d194 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85cce9430>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:32.354986 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-069590e6-c404-4167-b66e-005b4dd5d194 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 200 len: 353 microversion: 2.1 time: 0.149435 Feb 21 02:27:32.355758 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 3/4] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:32 2022] GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:32.363129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5d10e538-c18e-4786-87e1-ac309fddf905 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85ccff0d0>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:32.503096 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5d10e538-c18e-4786-87e1-ac309fddf905 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e" status: 200 len: 345 microversion: 2.1 time: 0.145842 Feb 21 02:27:32.512760 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 4/5] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:32 2022] GET /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:32.517984 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4e86fa1a-5ef9-4d48-9cb0-3b5c98f19ff1 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85cce9ee0>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:32.593298 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4e86fa1a-5ef9-4d48-9cb0-3b5c98f19ff1 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/536bdc64-cffe-4c5e-b45a-c2b78fce587c" status: 200 len: 351 microversion: 2.1 time: 0.078983 Feb 21 02:27:32.594018 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 5/6] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:32 2022] GET /compute/v2.1/os-volumes/536bdc64-cffe-4c5e-b45a-c2b78fce587c => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:32.605918 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8ab4856d-be97-4362-9457-98e1b35c9d04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:32.606762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8ab4856d-be97-4362-9457-98e1b35c9d04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:32.638847 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:27:32.639994 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:27:32.640700 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:27:32.641373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:27:32.642020 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:27:32.676142 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:32.678764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:32.681971 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:32.682544 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:32.771669 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Getting quotas for project c3d76be89b774996b1207493325848df. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:27:32.809187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Getting quotas for user b1925a549279483e9228a5d947bfdd81 and project c3d76be89b774996b1207493325848df. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:27:32.836953 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8ab4856d-be97-4362-9457-98e1b35c9d04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:32.852966 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:27:32.863002 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8ab4856d-be97-4362-9457-98e1b35c9d04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1218 microversion: 2.1 time: 0.267765 Feb 21 02:27:32.866826 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 6/7] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:32 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:32.867628 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:27:32.883283 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ac4d707e-af86-4767-a7d5-8f0b5fc261c8 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85ccffee0>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:32.991524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ac4d707e-af86-4767-a7d5-8f0b5fc261c8 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 200 len: 353 microversion: 2.1 time: 0.123372 Feb 21 02:27:33.003417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 7/8] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:32 2022] GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:33.003417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9c15138a-d4d3-4008-a728-b7a33c081577 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Action: 'create', calling method: .version_select at 0x7fd85cd19e50>, body: {"snapshot": {"volume_id": "6642a4e7-e57a-4f78-8883-55133549281e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2036880630"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:33.073252 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c9afcb52-5b33-4ff1-9767-7af248a4ebb6 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.185667 Feb 21 02:27:33.077444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 2/9] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:27:33.089258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7726400f-c4f6-4ab9-a547-423dfb5736ae tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85d568430>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:33.307068 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7726400f-c4f6-4ab9-a547-423dfb5736ae tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 202 len: 0 microversion: 2.1 time: 0.228093 Feb 21 02:27:33.308100 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 3/10] 10.222.0.75 () {58 vars in 1247 bytes} [Mon Feb 21 02:27:33 2022] DELETE /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:27:33.313326 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1db54ff8-c1eb-4707-b656-5efe81254569 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:33.314331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1db54ff8-c1eb-4707-b656-5efe81254569 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:33.589472 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1db54ff8-c1eb-4707-b656-5efe81254569 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:33.614404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1db54ff8-c1eb-4707-b656-5efe81254569 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1214 microversion: 2.1 time: 0.305058 Feb 21 02:27:33.622236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 4/11] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:33 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:33.634624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b7435131-5c3b-4706-99d0-8acd804c94d0 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85d568430>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:33.645968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9c15138a-d4d3-4008-a728-b7a33c081577 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.652389 Feb 21 02:27:33.646664 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 8/12] 10.222.0.75 () {60 vars in 1161 bytes} [Mon Feb 21 02:27:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:33.657439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-68380b42-05b7-40f3-b67a-0ca17b9b657b tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85cd28280>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:33.742038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-68380b42-05b7-40f3-b67a-0ca17b9b657b tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 200 len: 287 microversion: 2.1 time: 0.088327 Feb 21 02:27:33.743090 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 9/13] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:33 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:27:33.755138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f734f891-4e7c-4d78-952a-4c71c50e4759 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85cd28c10>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:33.791581 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b7435131-5c3b-4706-99d0-8acd804c94d0 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 200 len: 352 microversion: 2.1 time: 0.167262 Feb 21 02:27:33.792214 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 5/14] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:33 2022] GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:33.862127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f734f891-4e7c-4d78-952a-4c71c50e4759 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.111879 Feb 21 02:27:33.863454 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 10/15] 10.222.0.75 () {58 vars in 1139 bytes} [Mon Feb 21 02:27:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:33.874783 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ff35e48d-7a74-4548-9f61-9cd7d46678ae tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c4af040>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:33.885346 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1c09624c-c03c-41ef-9d81-ba5cf32398b2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:33.886019 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1c09624c-c03c-41ef-9d81-ba5cf32398b2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:34.038836 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ff35e48d-7a74-4548-9f61-9cd7d46678ae tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 200 len: 287 microversion: 2.1 time: 0.167716 Feb 21 02:27:34.043587 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 6/16] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:33 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:34.106375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1c09624c-c03c-41ef-9d81-ba5cf32398b2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:34.117440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1c09624c-c03c-41ef-9d81-ba5cf32398b2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1218 microversion: 2.1 time: 0.236528 Feb 21 02:27:34.121870 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 11/17] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:33 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:34.323929 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f310776e-181a-4e65-809f-b645b1921e40 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85c4af940>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:34.470070 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f310776e-181a-4e65-809f-b645b1921e40 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/d4258374-543f-4c12-b5f2-c1eb9d78e50e" status: 200 len: 350 microversion: 2.1 time: 0.150501 Feb 21 02:27:34.471320 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 7/18] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:34 2022] GET /compute/v2.1/os-volumes/d4258374-543f-4c12-b5f2-c1eb9d78e50e => generated 350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:34.649823 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-55693f78-2f13-42ff-900b-03fee1cdf864 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:34.650722 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-55693f78-2f13-42ff-900b-03fee1cdf864 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:34.804836 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-52a4ca8f-a855-4ac0-a3aa-d0745c4d90ae tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85c4afd30>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:34.938725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-52a4ca8f-a855-4ac0-a3aa-d0745c4d90ae tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 200 len: 352 microversion: 2.1 time: 0.138082 Feb 21 02:27:34.945290 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 8/19] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:34 2022] GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:35.051181 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-34908238-be46-4444-aa4f-a6ee8bb8a012 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c4af3a0>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:35.074729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-55693f78-2f13-42ff-900b-03fee1cdf864 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:35.099333 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-55693f78-2f13-42ff-900b-03fee1cdf864 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1214 microversion: 2.1 time: 0.464031 Feb 21 02:27:35.101150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 12/20] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:34 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1214 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:35.115798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-34908238-be46-4444-aa4f-a6ee8bb8a012 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 200 len: 287 microversion: 2.1 time: 0.068307 Feb 21 02:27:35.116667 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 9/21] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:35 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:27:35.140255 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b5880b95-9d3c-46f7-9fe9-13563505484f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:35.141732 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b5880b95-9d3c-46f7-9fe9-13563505484f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:35.154365 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b5880b95-9d3c-46f7-9fe9-13563505484f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:35.154793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b5880b95-9d3c-46f7-9fe9-13563505484f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:35.157807 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b5880b95-9d3c-46f7-9fe9-13563505484f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:35.158375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b5880b95-9d3c-46f7-9fe9-13563505484f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:35.384072 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b5880b95-9d3c-46f7-9fe9-13563505484f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:35.413863 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b5880b95-9d3c-46f7-9fe9-13563505484f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1222 microversion: 2.1 time: 0.277608 Feb 21 02:27:35.415508 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 13/22] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:35 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:35.953824 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e4d5a51e-304f-415a-a710-1d66a73b5503 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85d5685e0>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:36.062837 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e4d5a51e-304f-415a-a710-1d66a73b5503 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 200 len: 352 microversion: 2.1 time: 0.113627 Feb 21 02:27:36.064125 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 10/23] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:35 2022] GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:36.120886 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fd387826-341a-4641-a758-db2063215267 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:36.121888 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fd387826-341a-4641-a758-db2063215267 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:36.129562 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1f9734b8-5090-4b50-8ecc-96006569a8cd tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85cd05e50>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:36.154986 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd387826-341a-4641-a758-db2063215267 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:36.156573 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd387826-341a-4641-a758-db2063215267 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:36.170197 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd387826-341a-4641-a758-db2063215267 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:36.170849 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd387826-341a-4641-a758-db2063215267 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:36.211475 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1f9734b8-5090-4b50-8ecc-96006569a8cd tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 200 len: 287 microversion: 2.1 time: 0.086822 Feb 21 02:27:36.212368 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 11/24] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:36 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:36.432934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1a59461d-cdb0-46d5-a9f3-fdc043f176d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:36.434237 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1a59461d-cdb0-46d5-a9f3-fdc043f176d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:36.442383 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1a59461d-cdb0-46d5-a9f3-fdc043f176d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:36.443670 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1a59461d-cdb0-46d5-a9f3-fdc043f176d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:36.444826 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1a59461d-cdb0-46d5-a9f3-fdc043f176d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:36.445493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1a59461d-cdb0-46d5-a9f3-fdc043f176d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:36.492870 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fd387826-341a-4641-a758-db2063215267 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:36.503493 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fd387826-341a-4641-a758-db2063215267 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1218 microversion: 2.1 time: 0.389335 Feb 21 02:27:36.509928 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 14/25] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:36 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1218 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:36.704474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1a59461d-cdb0-46d5-a9f3-fdc043f176d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:36.728640 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1a59461d-cdb0-46d5-a9f3-fdc043f176d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1222 microversion: 2.1 time: 0.300700 Feb 21 02:27:36.736047 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 12/26] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:36 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1222 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:37.078919 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d20c13e0-6b59-471a-a1ca-2badca4fd976 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85c447550>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:37.183162 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d20c13e0-6b59-471a-a1ca-2badca4fd976 tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 200 len: 352 microversion: 2.1 time: 0.109725 Feb 21 02:27:37.184051 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 15/27] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:37 2022] GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:37.225787 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ca95c7d4-14b7-476c-9d52-2088b3b24bfd tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85cd05d30>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:37.299864 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ca95c7d4-14b7-476c-9d52-2088b3b24bfd tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 200 len: 287 microversion: 2.1 time: 0.079150 Feb 21 02:27:37.306156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 13/28] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:37 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:37.529063 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e3133f54-7c1e-45e2-9e2f-1a727f1d5b3b tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:37.532932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e3133f54-7c1e-45e2-9e2f-1a727f1d5b3b tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:37.557339 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3133f54-7c1e-45e2-9e2f-1a727f1d5b3b tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:37.562278 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3133f54-7c1e-45e2-9e2f-1a727f1d5b3b tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:37.569874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3133f54-7c1e-45e2-9e2f-1a727f1d5b3b tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:37.570836 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3133f54-7c1e-45e2-9e2f-1a727f1d5b3b tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:37.737437 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e3133f54-7c1e-45e2-9e2f-1a727f1d5b3b tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:37.748873 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e3133f54-7c1e-45e2-9e2f-1a727f1d5b3b tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1218 microversion: 2.1 time: 0.226217 Feb 21 02:27:37.749541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 16/29] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:37 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1218 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:37.753274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2cf8160f-b645-43e3-b1b6-387da50e2e6d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:37.753922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2cf8160f-b645-43e3-b1b6-387da50e2e6d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:37.763641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2cf8160f-b645-43e3-b1b6-387da50e2e6d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:37.791856 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2cf8160f-b645-43e3-b1b6-387da50e2e6d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:37.791856 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2cf8160f-b645-43e3-b1b6-387da50e2e6d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:37.791856 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2cf8160f-b645-43e3-b1b6-387da50e2e6d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:37.872741 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2cf8160f-b645-43e3-b1b6-387da50e2e6d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:37.881635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2cf8160f-b645-43e3-b1b6-387da50e2e6d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1222 microversion: 2.1 time: 0.131862 Feb 21 02:27:37.883086 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 14/30] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:37 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:38.198191 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-488b1d28-8a3f-48b6-a7f5-d0aec1d0e01c tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85d5e3310>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:38.267396 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-488b1d28-8a3f-48b6-a7f5-d0aec1d0e01c tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 200 len: 352 microversion: 2.1 time: 0.074406 Feb 21 02:27:38.268110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 17/31] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:38 2022] GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:38.314065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c32938ce-2939-4987-b3e6-5bdbafa5a8a4 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c49b700>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:38.379219 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c32938ce-2939-4987-b3e6-5bdbafa5a8a4 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 200 len: 287 microversion: 2.1 time: 0.070168 Feb 21 02:27:38.380156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 15/32] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:38 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:38.701910 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2012390101", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:38.767394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f3d14f9c-a843-466a-8d07-6c1b55193a4d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:38.768019 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f3d14f9c-a843-466a-8d07-6c1b55193a4d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:38.778768 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f3d14f9c-a843-466a-8d07-6c1b55193a4d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:38.779650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f3d14f9c-a843-466a-8d07-6c1b55193a4d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:38.780611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f3d14f9c-a843-466a-8d07-6c1b55193a4d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:38.781320 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f3d14f9c-a843-466a-8d07-6c1b55193a4d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:38.800375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] validate_networks() for [('92bfa233-3dc8-4ee8-9d61-df1a18ceb898', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:27:38.919181 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f3d14f9c-a843-466a-8d07-6c1b55193a4d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:38.933518 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f3d14f9c-a843-466a-8d07-6c1b55193a4d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1218 microversion: 2.1 time: 0.170071 Feb 21 02:27:38.945949 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 16/33] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:38 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:38.945949 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6c9f574e-131c-4775-a62d-65371a353e4f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:38.953089 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6c9f574e-131c-4775-a62d-65371a353e4f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:38.959760 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6c9f574e-131c-4775-a62d-65371a353e4f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:38.960577 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6c9f574e-131c-4775-a62d-65371a353e4f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:38.961579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6c9f574e-131c-4775-a62d-65371a353e4f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:38.962220 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6c9f574e-131c-4775-a62d-65371a353e4f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:39.218294 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6c9f574e-131c-4775-a62d-65371a353e4f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:39.227894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6c9f574e-131c-4775-a62d-65371a353e4f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1222 microversion: 2.1 time: 0.288215 Feb 21 02:27:39.228484 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 17/34] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:38 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1222 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:39.416848 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6b28d2b3-1432-4e4f-945b-a355d596e5fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'create', calling method: .version_select at 0x7fd85c4a4820>, body: {"keypair": {"name": "tempest-keypair-105809162"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:39.470984 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-6b28d2b3-1432-4e4f-945b-a355d596e5fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for project 09e923a4cc944b28979de727cb5269d1. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:27:39.475229 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:27:39.475915 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:27:39.476790 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:27:39.477619 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:27:39.478450 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:27:39.501308 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:39.501891 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:39.503186 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:39.503937 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:39.514666 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-6b28d2b3-1432-4e4f-945b-a355d596e5fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for user 30239e42418b4e33bdc1b9fb30b45004 and project 09e923a4cc944b28979de727cb5269d1. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:27:39.564725 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Getting quotas for project 34a6242d1dd24262be9852a4a5b1523d. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:27:39.579594 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Getting quotas for user ca2ee69b3d3347819e45881ef8ad5ac1 and project 34a6242d1dd24262be9852a4a5b1523d. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:27:39.619444 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:27:39.622458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:27:39.778234 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-6b28d2b3-1432-4e4f-945b-a355d596e5fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for project 09e923a4cc944b28979de727cb5269d1. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:27:39.791489 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-6b28d2b3-1432-4e4f-945b-a355d596e5fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for user 30239e42418b4e33bdc1b9fb30b45004 and project 09e923a4cc944b28979de727cb5269d1. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:27:39.794797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a73eb5a8-51fc-42d1-bc79-6b2320baee8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.301795 Feb 21 02:27:39.805964 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 18/35] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:27:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:27:39.809773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6b28d2b3-1432-4e4f-945b-a355d596e5fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.566772 Feb 21 02:27:39.810898 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 18/36] 10.222.0.75 () {60 vars in 1157 bytes} [Mon Feb 21 02:27:39 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:39.819331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6bb0d0ab-429c-4b3a-a3a2-522f1063fa12 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c4af3a0>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:39.826396 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-86134494-c879-4732-a286-1ac8405dfddc tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Calling method '.version_select at 0x7fd85cd19e50>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:39.866507 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6bb0d0ab-429c-4b3a-a3a2-522f1063fa12 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 200 len: 288 microversion: 2.1 time: 0.054370 Feb 21 02:27:39.867848 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 19/37] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:39 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 288 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:39.879071 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-578e4a98-0b7a-4725-8785-f5989f0ede54 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:39.879954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-578e4a98-0b7a-4725-8785-f5989f0ede54 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:39.950825 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-86134494-c879-4732-a286-1ac8405dfddc tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] HTTP exception thrown: Volume 8235e9f7-361c-44de-a7b4-8ad9424b13dd could not be found. Feb 21 02:27:39.951599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-86134494-c879-4732-a286-1ac8405dfddc tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] Returning 404 to user: Volume 8235e9f7-361c-44de-a7b4-8ad9424b13dd could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:27:39.953701 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-86134494-c879-4732-a286-1ac8405dfddc tempest-VolumesGetTestJSON-1874100102 tempest-VolumesGetTestJSON-1874100102-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd" status: 404 len: 109 microversion: 2.1 time: 0.146233 Feb 21 02:27:39.954673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 19/38] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:39 2022] GET /compute/v2.1/os-volumes/8235e9f7-361c-44de-a7b4-8ad9424b13dd => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:27:39.982179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-91126e17-8f7a-4faa-91c9-dfd3de04a7f3 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c461b80>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:40.058057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-578e4a98-0b7a-4725-8785-f5989f0ede54 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:40.073264 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-578e4a98-0b7a-4725-8785-f5989f0ede54 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1222 microversion: 2.1 time: 0.202182 Feb 21 02:27:40.074599 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 20/39] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:39 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:40.092611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fc22923a-aeca-48fd-bf58-c5d484cea758 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:40.094746 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fc22923a-aeca-48fd-bf58-c5d484cea758 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:40.137983 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fc22923a-aeca-48fd-bf58-c5d484cea758 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:40.141974 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fc22923a-aeca-48fd-bf58-c5d484cea758 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:40.145981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fc22923a-aeca-48fd-bf58-c5d484cea758 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:40.147399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fc22923a-aeca-48fd-bf58-c5d484cea758 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:40.187545 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-91126e17-8f7a-4faa-91c9-dfd3de04a7f3 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 202 len: 0 microversion: 2.1 time: 0.231158 Feb 21 02:27:40.193386 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 20/40] 10.222.0.75 () {58 vars in 1253 bytes} [Mon Feb 21 02:27:39 2022] DELETE /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:27:40.202698 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a0e70d17-879b-4726-868c-62067d37e347 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c461040>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:40.314239 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a0e70d17-879b-4726-868c-62067d37e347 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 200 len: 287 microversion: 2.1 time: 0.118813 Feb 21 02:27:40.315088 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 21/41] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:40 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:40.328262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b4d58762-ac9e-47ed-90bb-6ef62b3484a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:40.328954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b4d58762-ac9e-47ed-90bb-6ef62b3484a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:40.337636 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fc22923a-aeca-48fd-bf58-c5d484cea758 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:40.352332 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fc22923a-aeca-48fd-bf58-c5d484cea758 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1266 microversion: 2.1 time: 0.276030 Feb 21 02:27:40.354020 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 21/42] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:40 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:40.394700 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b4d58762-ac9e-47ed-90bb-6ef62b3484a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:40.408087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b4d58762-ac9e-47ed-90bb-6ef62b3484a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:40.413009 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b4d58762-ac9e-47ed-90bb-6ef62b3484a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:40.417309 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b4d58762-ac9e-47ed-90bb-6ef62b3484a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:40.627787 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2e06e396-ff0f-44a8-a7fe-2dda6fb70638 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85c49b280>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:40.849246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2e06e396-ff0f-44a8-a7fe-2dda6fb70638 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/fa5de68e-6508-4570-9052-49a2d699da8b" status: 200 len: 350 microversion: 2.1 time: 0.224748 Feb 21 02:27:40.851755 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 22/43] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:40 2022] GET /compute/v2.1/os-volumes/fa5de68e-6508-4570-9052-49a2d699da8b => generated 350 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:27:40.857331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1593262732", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:40.966838 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] validate_networks() for [('92bfa233-3dc8-4ee8-9d61-df1a18ceb898', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:27:41.138996 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b4d58762-ac9e-47ed-90bb-6ef62b3484a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:41.158416 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b4d58762-ac9e-47ed-90bb-6ef62b3484a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1270 microversion: 2.1 time: 0.833976 Feb 21 02:27:41.159181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 22/44] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:40 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1270 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:41.179997 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3807aff5-bed7-415f-a06e-d7878e5d71aa tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85c4a1040>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:41.398487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3807aff5-bed7-415f-a06e-d7878e5d71aa tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.234886 Feb 21 02:27:41.399506 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 23/45] 10.222.0.75 () {58 vars in 1133 bytes} [Mon Feb 21 02:27:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:41.412457 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-46e62ec3-033e-497a-b6a3-e1dc00eea222 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c3f6c10>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:41.452040 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-46e62ec3-033e-497a-b6a3-e1dc00eea222 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] HTTP exception thrown: Snapshot 43ff1f17-f75f-49de-b4d6-1a95a81029b7 could not be found. Feb 21 02:27:41.452828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-46e62ec3-033e-497a-b6a3-e1dc00eea222 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Returning 404 to user: Snapshot 43ff1f17-f75f-49de-b4d6-1a95a81029b7 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:27:41.453880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-46e62ec3-033e-497a-b6a3-e1dc00eea222 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7" status: 404 len: 111 microversion: 2.1 time: 0.052381 Feb 21 02:27:41.454817 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 24/46] 10.222.0.75 () {58 vars in 1250 bytes} [Mon Feb 21 02:27:41 2022] GET /compute/v2.1/os-snapshots/43ff1f17-f75f-49de-b4d6-1a95a81029b7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:27:41.466263 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e33777d5-e0ab-4497-a514-06df12bcd0ee tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:41.467033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e33777d5-e0ab-4497-a514-06df12bcd0ee tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:41.489145 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e33777d5-e0ab-4497-a514-06df12bcd0ee tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:41.493439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e33777d5-e0ab-4497-a514-06df12bcd0ee tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:41.519885 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e33777d5-e0ab-4497-a514-06df12bcd0ee tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:41.525102 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e33777d5-e0ab-4497-a514-06df12bcd0ee tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:41.645144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e33777d5-e0ab-4497-a514-06df12bcd0ee tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:41.653364 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e33777d5-e0ab-4497-a514-06df12bcd0ee tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1272 microversion: 2.1 time: 0.196756 Feb 21 02:27:41.665476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 25/47] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:41 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:41.674891 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-bca74466-82e2-465c-976c-f57585ba9439 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85cd19040>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:41.853082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-bca74466-82e2-465c-976c-f57585ba9439 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.185868 Feb 21 02:27:41.853861 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 26/48] 10.222.0.75 () {58 vars in 1148 bytes} [Mon Feb 21 02:27:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:41.868736 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fa82d86a-fa6d-48f6-a1cb-bf435ec39689 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c3f6e50>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:42.028511 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fa82d86a-fa6d-48f6-a1cb-bf435ec39689 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e" status: 202 len: 0 microversion: 2.1 time: 0.166688 Feb 21 02:27:42.029198 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 27/49] 10.222.0.75 () {58 vars in 1247 bytes} [Mon Feb 21 02:27:41 2022] DELETE /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:27:42.034295 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f9f98af1-3056-44d4-9ad7-6d059c1d8af7 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85c3f1790>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:42.256400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f9f98af1-3056-44d4-9ad7-6d059c1d8af7 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.225685 Feb 21 02:27:42.257197 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 28/50] 10.222.0.75 () {58 vars in 1133 bytes} [Mon Feb 21 02:27:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:42.269608 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-502494e0-05e4-4038-a081-77e84ea8168b tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85dc1a700>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:42.353937 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-502494e0-05e4-4038-a081-77e84ea8168b tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] HTTP exception thrown: Volume 6642a4e7-e57a-4f78-8883-55133549281e could not be found. Feb 21 02:27:42.354735 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-502494e0-05e4-4038-a081-77e84ea8168b tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Returning 404 to user: Volume 6642a4e7-e57a-4f78-8883-55133549281e could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:27:42.355824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-502494e0-05e4-4038-a081-77e84ea8168b tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e" status: 404 len: 109 microversion: 2.1 time: 0.090403 Feb 21 02:27:42.356745 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 29/51] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:42 2022] GET /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:27:42.375787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9c03be6e-141d-429c-ad3f-bc3c85074cb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:42.378490 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9c03be6e-141d-429c-ad3f-bc3c85074cb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:42.407352 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9c03be6e-141d-429c-ad3f-bc3c85074cb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:42.409567 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9c03be6e-141d-429c-ad3f-bc3c85074cb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:42.411875 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9c03be6e-141d-429c-ad3f-bc3c85074cb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:42.415688 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9c03be6e-141d-429c-ad3f-bc3c85074cb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:42.662937 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9c03be6e-141d-429c-ad3f-bc3c85074cb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:42.671187 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9c03be6e-141d-429c-ad3f-bc3c85074cb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1276 microversion: 2.1 time: 0.313197 Feb 21 02:27:42.678794 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 30/52] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:42 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1276 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:42.707142 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2fc36cf0-5b6c-43e3-8096-7a2ca30eaa82 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85dc1a700>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:42.881709 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2fc36cf0-5b6c-43e3-8096-7a2ca30eaa82 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.199876 Feb 21 02:27:42.882751 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 31/53] 10.222.0.75 () {58 vars in 1166 bytes} [Mon Feb 21 02:27:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:42.890419 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ce71484d-7639-4be7-9802-c71adcb7efdf tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85c3f6af0>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:42.931043 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-ce71484d-7639-4be7-9802-c71adcb7efdf tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] HTTP exception thrown: Volume 6642a4e7-e57a-4f78-8883-55133549281e could not be found. Feb 21 02:27:42.931651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ce71484d-7639-4be7-9802-c71adcb7efdf tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Returning 404 to user: Volume 6642a4e7-e57a-4f78-8883-55133549281e could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:27:42.932483 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ce71484d-7639-4be7-9802-c71adcb7efdf tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e" status: 404 len: 109 microversion: 2.1 time: 0.048649 Feb 21 02:27:42.933299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 32/54] 10.222.0.75 () {58 vars in 1247 bytes} [Mon Feb 21 02:27:42 2022] DELETE /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:27:42.943673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9858145d-23ff-41fd-aee3-cbe4779a16aa tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:42.944480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9858145d-23ff-41fd-aee3-cbe4779a16aa tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:42.956901 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9858145d-23ff-41fd-aee3-cbe4779a16aa tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:42.957360 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9858145d-23ff-41fd-aee3-cbe4779a16aa tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:42.963094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9858145d-23ff-41fd-aee3-cbe4779a16aa tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:42.970336 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9858145d-23ff-41fd-aee3-cbe4779a16aa tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:43.337332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9858145d-23ff-41fd-aee3-cbe4779a16aa tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:43.349777 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9858145d-23ff-41fd-aee3-cbe4779a16aa tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1272 microversion: 2.1 time: 0.415355 Feb 21 02:27:43.368697 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 33/55] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:42 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:43.374343 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-438020c8-fc17-42da-879a-27e9efae19ca tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85c4a1940>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:43.510377 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:27:43.511000 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:27:43.511254 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:27:43.511856 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:27:43.512425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:27:43.535690 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:43.537376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:43.546196 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:43.548468 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:43.596269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Getting quotas for project 34a6242d1dd24262be9852a4a5b1523d. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:27:43.609377 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Getting quotas for user ca2ee69b3d3347819e45881ef8ad5ac1 and project 34a6242d1dd24262be9852a4a5b1523d. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:27:43.633295 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-438020c8-fc17-42da-879a-27e9efae19ca tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.262972 Feb 21 02:27:43.634182 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 34/56] 10.222.0.75 () {58 vars in 1169 bytes} [Mon Feb 21 02:27:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:43.638940 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9359291a-a1ed-46ef-b37f-240de5ecb568 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Calling method '.version_select at 0x7fd85cce93a0>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:43.650021 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:27:43.652554 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:27:43.700482 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-9359291a-a1ed-46ef-b37f-240de5ecb568 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] HTTP exception thrown: Volume 6642a4e7-e57a-4f78-8883-55133549281e could not be found. Feb 21 02:27:43.701532 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9359291a-a1ed-46ef-b37f-240de5ecb568 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] Returning 404 to user: Volume 6642a4e7-e57a-4f78-8883-55133549281e could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:27:43.702637 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9359291a-a1ed-46ef-b37f-240de5ecb568 tempest-VolumesSnapshotsTestJSON-1421738922 tempest-VolumesSnapshotsTestJSON-1421738922-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e" status: 404 len: 109 microversion: 2.1 time: 0.067335 Feb 21 02:27:43.704353 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 35/57] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:27:43 2022] GET /compute/v2.1/os-volumes/6642a4e7-e57a-4f78-8883-55133549281e => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:27:43.733891 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fac77ca2-81e5-48de-9b6e-bf4959a7d3bc tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85c4303a0>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:43.762416 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d2153413-9b96-4160-96d3-0fcde1401c8b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.909282 Feb 21 02:27:43.763899 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 23/58] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:27:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:27:43.778198 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4a8b8b93-72d4-4c04-bbe0-eb5b81ae6bb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:43.779181 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4a8b8b93-72d4-4c04-bbe0-eb5b81ae6bb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:43.800079 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4a8b8b93-72d4-4c04-bbe0-eb5b81ae6bb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:43.802327 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4a8b8b93-72d4-4c04-bbe0-eb5b81ae6bb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:43.803467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4a8b8b93-72d4-4c04-bbe0-eb5b81ae6bb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:43.805901 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4a8b8b93-72d4-4c04-bbe0-eb5b81ae6bb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:44.024131 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fac77ca2-81e5-48de-9b6e-bf4959a7d3bc tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.318501 Feb 21 02:27:44.024952 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 36/59] 10.222.0.75 () {58 vars in 1154 bytes} [Mon Feb 21 02:27:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:44.029609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-89b69865-e17a-441f-af37-b5b6474a4ac5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:44.030628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-89b69865-e17a-441f-af37-b5b6474a4ac5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:44.282148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-89b69865-e17a-441f-af37-b5b6474a4ac5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:44.289239 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-89b69865-e17a-441f-af37-b5b6474a4ac5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1222 microversion: 2.1 time: 0.262948 Feb 21 02:27:44.293601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 37/60] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:44 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1222 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:44.318448 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-72ae6a15-9577-4779-a430-58b7d5919881 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85cd19670>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:44.588294 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-72ae6a15-9577-4779-a430-58b7d5919881 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.292342 Feb 21 02:27:44.589749 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 38/61] 10.222.0.75 () {58 vars in 1187 bytes} [Mon Feb 21 02:27:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:44.594386 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2609565f-e3dd-48f2-bba9-c0927e641bf3 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:44.595188 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2609565f-e3dd-48f2-bba9-c0927e641bf3 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:44.613560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2609565f-e3dd-48f2-bba9-c0927e641bf3 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:44.614295 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2609565f-e3dd-48f2-bba9-c0927e641bf3 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:44.616086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2609565f-e3dd-48f2-bba9-c0927e641bf3 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:44.618751 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2609565f-e3dd-48f2-bba9-c0927e641bf3 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:45.291435 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2609565f-e3dd-48f2-bba9-c0927e641bf3 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:45.301598 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2609565f-e3dd-48f2-bba9-c0927e641bf3 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1272 microversion: 2.1 time: 0.710601 Feb 21 02:27:45.303234 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 39/62] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:44 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1272 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:45.319452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-67931ff9-1f1a-4b21-a5d3-34b1ffcdf306 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] Calling method '.version_select at 0x7fd85cd19040>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:45.575975 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-67931ff9-1f1a-4b21-a5d3-34b1ffcdf306 tempest-VolumesTestJSON-408432834 tempest-VolumesTestJSON-408432834-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.269147 Feb 21 02:27:45.576543 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 40/63] 10.222.0.75 () {58 vars in 1154 bytes} [Mon Feb 21 02:27:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:45.580981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-71f51a75-c711-4dac-b017-c1e62a102c04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:45.581789 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-71f51a75-c711-4dac-b017-c1e62a102c04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:45.630509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-71f51a75-c711-4dac-b017-c1e62a102c04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:45.631754 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-71f51a75-c711-4dac-b017-c1e62a102c04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:45.632776 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-71f51a75-c711-4dac-b017-c1e62a102c04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:45.633410 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-71f51a75-c711-4dac-b017-c1e62a102c04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:46.199290 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-71f51a75-c711-4dac-b017-c1e62a102c04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:46.206891 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-71f51a75-c711-4dac-b017-c1e62a102c04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1274 microversion: 2.1 time: 0.629104 Feb 21 02:27:46.207397 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 41/64] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:45 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1274 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:46.298899 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4a8b8b93-72d4-4c04-bbe0-eb5b81ae6bb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:46.309959 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4a8b8b93-72d4-4c04-bbe0-eb5b81ae6bb4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 2.543988 Feb 21 02:27:46.320451 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ba69c18d-baff-4c4a-92df-2fb5a19fa83d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:46.320689 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 24/65] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:43 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:46.321443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ba69c18d-baff-4c4a-92df-2fb5a19fa83d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:46.328680 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ba69c18d-baff-4c4a-92df-2fb5a19fa83d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:46.338010 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ba69c18d-baff-4c4a-92df-2fb5a19fa83d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:46.343036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ba69c18d-baff-4c4a-92df-2fb5a19fa83d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:46.343665 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ba69c18d-baff-4c4a-92df-2fb5a19fa83d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:47.238683 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-585d20bf-43d2-427d-9d1e-3a52797d3898 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:47.240624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-585d20bf-43d2-427d-9d1e-3a52797d3898 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:47.247955 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-585d20bf-43d2-427d-9d1e-3a52797d3898 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:47.248650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-585d20bf-43d2-427d-9d1e-3a52797d3898 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:47.249660 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-585d20bf-43d2-427d-9d1e-3a52797d3898 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:47.250237 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-585d20bf-43d2-427d-9d1e-3a52797d3898 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:47.513087 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-585d20bf-43d2-427d-9d1e-3a52797d3898 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:47.534885 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-585d20bf-43d2-427d-9d1e-3a52797d3898 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1280 microversion: 2.1 time: 0.307225 Feb 21 02:27:47.538426 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 25/66] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:47 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:47.554284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9bb8fa5e-0a33-4067-b061-f81fd5940afa tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:47.555066 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9bb8fa5e-0a33-4067-b061-f81fd5940afa tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:47.573928 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9bb8fa5e-0a33-4067-b061-f81fd5940afa tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:47.574396 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9bb8fa5e-0a33-4067-b061-f81fd5940afa tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:47.575880 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9bb8fa5e-0a33-4067-b061-f81fd5940afa tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:47.576720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9bb8fa5e-0a33-4067-b061-f81fd5940afa tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:47.951785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ba69c18d-baff-4c4a-92df-2fb5a19fa83d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:47.963818 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ba69c18d-baff-4c4a-92df-2fb5a19fa83d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 1.646972 Feb 21 02:27:47.967171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 42/67] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:46 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:48.555932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b8d6ed0c-9ec3-4686-889a-eaa981c735ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:48.557039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b8d6ed0c-9ec3-4686-889a-eaa981c735ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:48.568528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed0c-9ec3-4686-889a-eaa981c735ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:48.569004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed0c-9ec3-4686-889a-eaa981c735ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:48.569876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed0c-9ec3-4686-889a-eaa981c735ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:48.570324 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed0c-9ec3-4686-889a-eaa981c735ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:48.663147 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9bb8fa5e-0a33-4067-b061-f81fd5940afa tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:48.671234 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9bb8fa5e-0a33-4067-b061-f81fd5940afa tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 1.130297 Feb 21 02:27:48.674695 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 26/68] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:47 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:48.758046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b8d6ed0c-9ec3-4686-889a-eaa981c735ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:48.776122 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b8d6ed0c-9ec3-4686-889a-eaa981c735ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1280 microversion: 2.1 time: 0.223856 Feb 21 02:27:48.776701 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 43/69] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:48 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:48.986876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1c5611e6-705f-4385-b8d7-5fd5d4fa43e7 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:48.987902 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1c5611e6-705f-4385-b8d7-5fd5d4fa43e7 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:48.997151 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1c5611e6-705f-4385-b8d7-5fd5d4fa43e7 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:49.000467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1c5611e6-705f-4385-b8d7-5fd5d4fa43e7 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:49.001684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1c5611e6-705f-4385-b8d7-5fd5d4fa43e7 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:49.002298 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1c5611e6-705f-4385-b8d7-5fd5d4fa43e7 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:49.691651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7472cf8d-6fc7-42f8-879b-152927667331 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:49.693531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7472cf8d-6fc7-42f8-879b-152927667331 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:49.703429 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7472cf8d-6fc7-42f8-879b-152927667331 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:49.704124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7472cf8d-6fc7-42f8-879b-152927667331 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:49.705072 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7472cf8d-6fc7-42f8-879b-152927667331 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:49.710840 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7472cf8d-6fc7-42f8-879b-152927667331 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:49.960269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1c5611e6-705f-4385-b8d7-5fd5d4fa43e7 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:49.974694 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1c5611e6-705f-4385-b8d7-5fd5d4fa43e7 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.990846 Feb 21 02:27:49.976529 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 27/70] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:48 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:49.984760 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bd51a0db-8106-4aa0-9530-70ab14f3750c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:49.986040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bd51a0db-8106-4aa0-9530-70ab14f3750c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:49.996491 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bd51a0db-8106-4aa0-9530-70ab14f3750c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:49.996822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bd51a0db-8106-4aa0-9530-70ab14f3750c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:49.998280 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bd51a0db-8106-4aa0-9530-70ab14f3750c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:49.999055 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bd51a0db-8106-4aa0-9530-70ab14f3750c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:50.136119 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bd51a0db-8106-4aa0-9530-70ab14f3750c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:50.151783 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bd51a0db-8106-4aa0-9530-70ab14f3750c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1280 microversion: 2.1 time: 0.170850 Feb 21 02:27:50.152420 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 28/71] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:49 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:50.349195 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7472cf8d-6fc7-42f8-879b-152927667331 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:50.365109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7472cf8d-6fc7-42f8-879b-152927667331 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.676871 Feb 21 02:27:50.368542 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 44/72] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:49 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:50.419199 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1843120623", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7984c99a-2bf0-4380-ab96-7d2375b9f90f"}], "security_groups": [{"name": "tempest-securitygroup--1371569334"}], "key_name": "tempest-keypair-105809162", "user_data": "}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:50.579619 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-96641819-c631-424c-858f-8ee0e6a530ac req-ea383b8c-72fa-4812-bf53-dbdcba8d78d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2034fae-347a-4500-8cbf-606b03dcfcc5", "tag": "2460a313-d85b-438c-8bd0-f46e5ebbd9ff"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:50.582135 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:27:50.582135 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:27:50.613977 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-96641819-c631-424c-858f-8ee0e6a530ac req-ea383b8c-72fa-4812-bf53-dbdcba8d78d9 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:50.614757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-96641819-c631-424c-858f-8ee0e6a530ac req-ea383b8c-72fa-4812-bf53-dbdcba8d78d9 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:50.673213 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-96641819-c631-424c-858f-8ee0e6a530ac req-ea383b8c-72fa-4812-bf53-dbdcba8d78d9 service nova] Creating event network-changed:2460a313-d85b-438c-8bd0-f46e5ebbd9ff for instance f2034fae-347a-4500-8cbf-606b03dcfcc5 on hv-cinder-80447 Feb 21 02:27:50.674018 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-96641819-c631-424c-858f-8ee0e6a530ac req-ea383b8c-72fa-4812-bf53-dbdcba8d78d9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116710) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 02:27:50.675476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7515da8e-0579-4040-9074-69666244a4a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:50.676174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7515da8e-0579-4040-9074-69666244a4a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:50.677419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7515da8e-0579-4040-9074-69666244a4a8 None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:50.678099 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7515da8e-0579-4040-9074-69666244a4a8 None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:50.687344 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.compute.rpcapi [None req-7515da8e-0579-4040-9074-69666244a4a8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 02:27:50.693892 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7515da8e-0579-4040-9074-69666244a4a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=116710) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 02:27:50.729877 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7515da8e-0579-4040-9074-69666244a4a8 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.496645 Feb 21 02:27:50.730866 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 29/73] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:27:50.993035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-46a5b552-77d0-44c8-90f0-5dd59b968550 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:50.994656 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-46a5b552-77d0-44c8-90f0-5dd59b968550 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:51.008067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-46a5b552-77d0-44c8-90f0-5dd59b968550 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:51.008696 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-46a5b552-77d0-44c8-90f0-5dd59b968550 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:51.013284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-46a5b552-77d0-44c8-90f0-5dd59b968550 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:51.014057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-46a5b552-77d0-44c8-90f0-5dd59b968550 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:51.064021 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] validate_networks() for [('7984c99a-2bf0-4380-ab96-7d2375b9f90f', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:27:51.808722 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-46a5b552-77d0-44c8-90f0-5dd59b968550 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:51.822660 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-46a5b552-77d0-44c8-90f0-5dd59b968550 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.834023 Feb 21 02:27:51.823935 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 30/74] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:50 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:52.055168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:27:52.055659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:27:52.056155 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:27:52.056609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:27:52.057039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:27:52.071092 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:52.073494 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:52.075560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:52.077574 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:52.121171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for project 09e923a4cc944b28979de727cb5269d1. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:27:52.128173 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for user 30239e42418b4e33bdc1b9fb30b45004 and project 09e923a4cc944b28979de727cb5269d1. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:27:52.151812 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:27:52.154339 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:27:52.216203 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-78168d42-4bda-4a44-99c8-f809a0d60c67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.801947 Feb 21 02:27:52.217481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 45/75] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:27:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 02:27:52.223036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a5dfab2f-3592-4d21-92aa-9016a68ffd18 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:52.224496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a5dfab2f-3592-4d21-92aa-9016a68ffd18 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:52.236466 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a5dfab2f-3592-4d21-92aa-9016a68ffd18 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:52.237237 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a5dfab2f-3592-4d21-92aa-9016a68ffd18 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:52.238275 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a5dfab2f-3592-4d21-92aa-9016a68ffd18 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:52.238927 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a5dfab2f-3592-4d21-92aa-9016a68ffd18 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:52.744563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-5841f1bb-2cdc-4df8-b608-43f0c88b4435 req-f3dde2e1-fa73-4eb3-8171-6202d05f08ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57db8fe7-822f-4654-af4d-f883ba203764", "tag": "564ee339-f6a7-4482-9e82-3e4945304a7c"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:52.746172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:27:52.746172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:27:52.773456 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-5841f1bb-2cdc-4df8-b608-43f0c88b4435 req-f3dde2e1-fa73-4eb3-8171-6202d05f08ab service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:52.775468 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-5841f1bb-2cdc-4df8-b608-43f0c88b4435 req-f3dde2e1-fa73-4eb3-8171-6202d05f08ab service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:52.819873 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-5841f1bb-2cdc-4df8-b608-43f0c88b4435 req-f3dde2e1-fa73-4eb3-8171-6202d05f08ab service nova] Creating event network-changed:564ee339-f6a7-4482-9e82-3e4945304a7c for instance 57db8fe7-822f-4654-af4d-f883ba203764 on hv-cinder-80447 Feb 21 02:27:52.837922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-5841f1bb-2cdc-4df8-b608-43f0c88b4435 req-f3dde2e1-fa73-4eb3-8171-6202d05f08ab service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.012416 Feb 21 02:27:52.841664 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 31/76] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:52.862947 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f56acf76-0753-4793-84dd-b28114f61b14 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:52.864517 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f56acf76-0753-4793-84dd-b28114f61b14 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:52.882915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f56acf76-0753-4793-84dd-b28114f61b14 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:52.884132 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f56acf76-0753-4793-84dd-b28114f61b14 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:52.886530 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f56acf76-0753-4793-84dd-b28114f61b14 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:52.888109 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f56acf76-0753-4793-84dd-b28114f61b14 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:53.345557 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a5dfab2f-3592-4d21-92aa-9016a68ffd18 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:53.356069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a5dfab2f-3592-4d21-92aa-9016a68ffd18 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 1.136495 Feb 21 02:27:53.357954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 46/77] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:52 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:53.365675 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-13e4ac87-db3b-45e2-8ea6-27beab29489d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:53.376249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-13e4ac87-db3b-45e2-8ea6-27beab29489d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:53.392928 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-13e4ac87-db3b-45e2-8ea6-27beab29489d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:53.393740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-13e4ac87-db3b-45e2-8ea6-27beab29489d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:53.394769 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-13e4ac87-db3b-45e2-8ea6-27beab29489d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:53.395453 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-13e4ac87-db3b-45e2-8ea6-27beab29489d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:53.542957 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-13e4ac87-db3b-45e2-8ea6-27beab29489d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:53.566262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-13e4ac87-db3b-45e2-8ea6-27beab29489d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1241 microversion: 2.1 time: 0.204695 Feb 21 02:27:53.581395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 47/78] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:53 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:53.605172 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-96ed9c3b-5568-43f1-afc7-69f9f83aaca0 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:53.606220 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-96ed9c3b-5568-43f1-afc7-69f9f83aaca0 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:53.622869 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-96ed9c3b-5568-43f1-afc7-69f9f83aaca0 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:53.625581 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-96ed9c3b-5568-43f1-afc7-69f9f83aaca0 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:53.626720 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-96ed9c3b-5568-43f1-afc7-69f9f83aaca0 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:53.627167 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-96ed9c3b-5568-43f1-afc7-69f9f83aaca0 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:54.243769 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f56acf76-0753-4793-84dd-b28114f61b14 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:54.255805 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f56acf76-0753-4793-84dd-b28114f61b14 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 1.409477 Feb 21 02:27:54.256647 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 32/79] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:52 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:54.270239 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-3ec69d84-a79c-4e47-ae80-3596f5b668ff req-ce2692f4-d87e-4df2-ae4f-18f74b260a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aeae50f-fa12-4250-8e53-9a5fcdded6d3", "tag": "71ba9208-2448-4764-bb34-2672da8a2c21"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:54.292404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:27:54.292404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:27:54.345757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-3ec69d84-a79c-4e47-ae80-3596f5b668ff req-ce2692f4-d87e-4df2-ae4f-18f74b260a6f service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:54.347010 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-3ec69d84-a79c-4e47-ae80-3596f5b668ff req-ce2692f4-d87e-4df2-ae4f-18f74b260a6f service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:54.410013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-3ec69d84-a79c-4e47-ae80-3596f5b668ff req-ce2692f4-d87e-4df2-ae4f-18f74b260a6f service nova] Creating event network-changed:71ba9208-2448-4764-bb34-2672da8a2c21 for instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 on hv-cinder-80447 Feb 21 02:27:54.447185 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-3ec69d84-a79c-4e47-ae80-3596f5b668ff req-ce2692f4-d87e-4df2-ae4f-18f74b260a6f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187447 Feb 21 02:27:54.449840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 33/80] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:54.459234 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bf9462c2-d9f3-4afa-b3f3-0b2beeb46971 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:54.460767 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bf9462c2-d9f3-4afa-b3f3-0b2beeb46971 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:54.487900 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf9462c2-d9f3-4afa-b3f3-0b2beeb46971 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:54.491423 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf9462c2-d9f3-4afa-b3f3-0b2beeb46971 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:54.492824 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf9462c2-d9f3-4afa-b3f3-0b2beeb46971 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:54.493472 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf9462c2-d9f3-4afa-b3f3-0b2beeb46971 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:54.863028 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-96ed9c3b-5568-43f1-afc7-69f9f83aaca0 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:54.878530 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-96ed9c3b-5568-43f1-afc7-69f9f83aaca0 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 1.294889 Feb 21 02:27:54.894454 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 48/81] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:53 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:54.900874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-cc2dbb19-9dc5-4d32-997a-774f93d6762a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:54.901913 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-cc2dbb19-9dc5-4d32-997a-774f93d6762a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:54.912575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cc2dbb19-9dc5-4d32-997a-774f93d6762a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:54.914991 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cc2dbb19-9dc5-4d32-997a-774f93d6762a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:54.916827 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cc2dbb19-9dc5-4d32-997a-774f93d6762a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:54.917521 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cc2dbb19-9dc5-4d32-997a-774f93d6762a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:55.068539 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cc2dbb19-9dc5-4d32-997a-774f93d6762a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:55.087991 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-cc2dbb19-9dc5-4d32-997a-774f93d6762a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1295 microversion: 2.1 time: 0.191684 Feb 21 02:27:55.089256 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 49/82] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:54 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:55.125110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-4f2a19d2-fd60-4543-8c57-92d7c5420bf1 req-d32f0f82-f99e-4f2d-a03a-43fa53245e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c909020c-1e47-4a5c-826f-c8d88b2c7a05", "tag": "10b7d237-63f4-46b8-9fb5-022ff16a013d"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:55.136780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:27:55.136780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:27:55.170553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-4f2a19d2-fd60-4543-8c57-92d7c5420bf1 req-d32f0f82-f99e-4f2d-a03a-43fa53245e67 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:55.174429 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-4f2a19d2-fd60-4543-8c57-92d7c5420bf1 req-d32f0f82-f99e-4f2d-a03a-43fa53245e67 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:55.244299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-4f2a19d2-fd60-4543-8c57-92d7c5420bf1 req-d32f0f82-f99e-4f2d-a03a-43fa53245e67 service nova] Creating event network-changed:10b7d237-63f4-46b8-9fb5-022ff16a013d for instance c909020c-1e47-4a5c-826f-c8d88b2c7a05 on hv-cinder-80447 Feb 21 02:27:55.246590 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-4f2a19d2-fd60-4543-8c57-92d7c5420bf1 req-d32f0f82-f99e-4f2d-a03a-43fa53245e67 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 02:27:55.248493 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aad51a20-a6c1-427e-9119-ffb95c1e88bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:55.250931 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aad51a20-a6c1-427e-9119-ffb95c1e88bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:55.257606 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aad51a20-a6c1-427e-9119-ffb95c1e88bb None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:55.258794 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aad51a20-a6c1-427e-9119-ffb95c1e88bb None None] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:55.298816 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.compute.rpcapi [None req-aad51a20-a6c1-427e-9119-ffb95c1e88bb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 02:27:55.300326 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aad51a20-a6c1-427e-9119-ffb95c1e88bb None None] Releasing lock "compute-rpcapi-router" {{(pid=116711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 02:27:55.338223 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-aad51a20-a6c1-427e-9119-ffb95c1e88bb None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222124 Feb 21 02:27:55.339614 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 50/83] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:55.356830 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e2ab1b82-15fe-4f6b-92f8-89d57b18b80b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:55.369136 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e2ab1b82-15fe-4f6b-92f8-89d57b18b80b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:55.397909 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e2ab1b82-15fe-4f6b-92f8-89d57b18b80b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:55.401980 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e2ab1b82-15fe-4f6b-92f8-89d57b18b80b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:55.403411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e2ab1b82-15fe-4f6b-92f8-89d57b18b80b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:55.404111 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e2ab1b82-15fe-4f6b-92f8-89d57b18b80b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:55.451634 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bf9462c2-d9f3-4afa-b3f3-0b2beeb46971 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:55.471161 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bf9462c2-d9f3-4afa-b3f3-0b2beeb46971 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 1.017219 Feb 21 02:27:55.490062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 34/84] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:54 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:55.897881 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-aafcfa18-5da1-4dca-af28-7444ecc252cf tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:55.899241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-aafcfa18-5da1-4dca-af28-7444ecc252cf tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:55.907269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e2ab1b82-15fe-4f6b-92f8-89d57b18b80b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:55.910589 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aafcfa18-5da1-4dca-af28-7444ecc252cf tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:55.912013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aafcfa18-5da1-4dca-af28-7444ecc252cf tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:55.913906 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aafcfa18-5da1-4dca-af28-7444ecc252cf tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:55.915305 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aafcfa18-5da1-4dca-af28-7444ecc252cf tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:55.921523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e2ab1b82-15fe-4f6b-92f8-89d57b18b80b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.580170 Feb 21 02:27:55.924480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 51/85] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:55 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:56.106732 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f8c4fed0-1ef4-4f56-ba55-6e0269abada8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:56.107258 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f8c4fed0-1ef4-4f56-ba55-6e0269abada8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:56.117144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f8c4fed0-1ef4-4f56-ba55-6e0269abada8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:56.117588 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f8c4fed0-1ef4-4f56-ba55-6e0269abada8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:56.118387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f8c4fed0-1ef4-4f56-ba55-6e0269abada8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:56.123990 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f8c4fed0-1ef4-4f56-ba55-6e0269abada8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:56.227943 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f8c4fed0-1ef4-4f56-ba55-6e0269abada8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:56.236969 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f8c4fed0-1ef4-4f56-ba55-6e0269abada8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1295 microversion: 2.1 time: 0.135107 Feb 21 02:27:56.238313 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 52/86] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:56 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1295 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:56.351549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aafcfa18-5da1-4dca-af28-7444ecc252cf tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:56.371399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-aafcfa18-5da1-4dca-af28-7444ecc252cf tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.478329 Feb 21 02:27:56.372288 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 35/87] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:55 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:56.493176 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-60697d13-39f0-4efd-a309-8027afc0d485 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:56.493850 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-60697d13-39f0-4efd-a309-8027afc0d485 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:56.503070 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60697d13-39f0-4efd-a309-8027afc0d485 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:56.505801 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60697d13-39f0-4efd-a309-8027afc0d485 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:56.509629 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60697d13-39f0-4efd-a309-8027afc0d485 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:56.512429 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60697d13-39f0-4efd-a309-8027afc0d485 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:56.872362 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-60697d13-39f0-4efd-a309-8027afc0d485 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:56.890420 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-60697d13-39f0-4efd-a309-8027afc0d485 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.404669 Feb 21 02:27:56.893551 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 53/88] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:56 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:56.940380 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0b766e60-bb14-4015-9a80-b804a8f703a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:56.941005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0b766e60-bb14-4015-9a80-b804a8f703a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:56.948620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0b766e60-bb14-4015-9a80-b804a8f703a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:56.950168 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0b766e60-bb14-4015-9a80-b804a8f703a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:56.951692 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0b766e60-bb14-4015-9a80-b804a8f703a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:56.952384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0b766e60-bb14-4015-9a80-b804a8f703a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:57.256362 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ee9c681f-c0d0-4073-b2e8-9eb09ff89bb4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:57.257007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ee9c681f-c0d0-4073-b2e8-9eb09ff89bb4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:57.263571 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ee9c681f-c0d0-4073-b2e8-9eb09ff89bb4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:57.264102 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ee9c681f-c0d0-4073-b2e8-9eb09ff89bb4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:57.264892 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ee9c681f-c0d0-4073-b2e8-9eb09ff89bb4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:57.265325 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ee9c681f-c0d0-4073-b2e8-9eb09ff89bb4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:57.529137 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ee9c681f-c0d0-4073-b2e8-9eb09ff89bb4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:57.541191 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ee9c681f-c0d0-4073-b2e8-9eb09ff89bb4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.286491 Feb 21 02:27:57.541883 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 54/89] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:57 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:57.547739 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2272902c-f313-4fc9-9260-eb9134547917 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:57.548676 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2272902c-f313-4fc9-9260-eb9134547917 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:57.569691 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2272902c-f313-4fc9-9260-eb9134547917 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:57.572201 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2272902c-f313-4fc9-9260-eb9134547917 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:57.578888 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2272902c-f313-4fc9-9260-eb9134547917 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:57.579838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2272902c-f313-4fc9-9260-eb9134547917 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:57.638883 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0b766e60-bb14-4015-9a80-b804a8f703a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:57.650362 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0b766e60-bb14-4015-9a80-b804a8f703a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.712920 Feb 21 02:27:57.652875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 36/90] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:56 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:57.858398 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2272902c-f313-4fc9-9260-eb9134547917 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:57.879144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2272902c-f313-4fc9-9260-eb9134547917 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.335994 Feb 21 02:27:57.891753 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 55/91] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:57 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:57.909004 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-85876667-7909-414a-9ae3-7c6cebfac0cf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:57.909789 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-85876667-7909-414a-9ae3-7c6cebfac0cf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:57.919053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85876667-7909-414a-9ae3-7c6cebfac0cf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:57.919746 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85876667-7909-414a-9ae3-7c6cebfac0cf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:57.920912 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85876667-7909-414a-9ae3-7c6cebfac0cf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:57.921703 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85876667-7909-414a-9ae3-7c6cebfac0cf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:58.464042 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-85876667-7909-414a-9ae3-7c6cebfac0cf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:58.478048 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-85876667-7909-414a-9ae3-7c6cebfac0cf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.573257 Feb 21 02:27:58.490206 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 37/92] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:57 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:58.561959 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4431b452-4fff-488d-bec2-b7f55d00762b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:58.574094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4431b452-4fff-488d-bec2-b7f55d00762b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:58.575248 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-67c957ba-a312-41bd-9ccd-061d52ed686d req-20528411-b8c4-4e1f-b17f-03a84c798ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af65eb3-dbe6-4a66-919e-c8a6884b613c", "tag": "754d6b40-0964-484e-9d3d-46275c69f4cb"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:27:58.577023 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:27:58.577023 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:27:58.594734 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-67c957ba-a312-41bd-9ccd-061d52ed686d req-20528411-b8c4-4e1f-b17f-03a84c798ad9 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:58.595336 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-67c957ba-a312-41bd-9ccd-061d52ed686d req-20528411-b8c4-4e1f-b17f-03a84c798ad9 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:58.606376 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4431b452-4fff-488d-bec2-b7f55d00762b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:58.608190 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4431b452-4fff-488d-bec2-b7f55d00762b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:58.609464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4431b452-4fff-488d-bec2-b7f55d00762b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:58.610078 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4431b452-4fff-488d-bec2-b7f55d00762b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:58.627544 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-67c957ba-a312-41bd-9ccd-061d52ed686d req-20528411-b8c4-4e1f-b17f-03a84c798ad9 service nova] Creating event network-changed:754d6b40-0964-484e-9d3d-46275c69f4cb for instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c on hv-cinder-80447 Feb 21 02:27:58.639762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-67c957ba-a312-41bd-9ccd-061d52ed686d req-20528411-b8c4-4e1f-b17f-03a84c798ad9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066788 Feb 21 02:27:58.640383 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 38/93] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:27:58.670843 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-425e79f6-09e2-4d97-bc25-b176b4024a7a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:58.671815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-425e79f6-09e2-4d97-bc25-b176b4024a7a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:58.681847 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-425e79f6-09e2-4d97-bc25-b176b4024a7a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:58.683926 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-425e79f6-09e2-4d97-bc25-b176b4024a7a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:58.685181 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-425e79f6-09e2-4d97-bc25-b176b4024a7a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:58.687188 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-425e79f6-09e2-4d97-bc25-b176b4024a7a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:58.928664 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4431b452-4fff-488d-bec2-b7f55d00762b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:58.939117 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4431b452-4fff-488d-bec2-b7f55d00762b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.384587 Feb 21 02:27:58.940309 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 56/94] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:58 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:58.953804 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8d770a6d-1857-4cc1-8200-c39e2185e11d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:58.954851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8d770a6d-1857-4cc1-8200-c39e2185e11d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:58.993103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8d770a6d-1857-4cc1-8200-c39e2185e11d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:59.010635 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8d770a6d-1857-4cc1-8200-c39e2185e11d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:59.011508 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8d770a6d-1857-4cc1-8200-c39e2185e11d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:59.013884 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8d770a6d-1857-4cc1-8200-c39e2185e11d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:59.168635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-425e79f6-09e2-4d97-bc25-b176b4024a7a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:59.176250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-425e79f6-09e2-4d97-bc25-b176b4024a7a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.509362 Feb 21 02:27:59.188227 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 39/95] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:58 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:27:59.195130 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8d770a6d-1857-4cc1-8200-c39e2185e11d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:59.205681 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8d770a6d-1857-4cc1-8200-c39e2185e11d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.263805 Feb 21 02:27:59.215826 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 57/96] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:58 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:27:59.498062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-dbb373ea-c069-4484-ad34-7f76ae136231 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:59.498674 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-dbb373ea-c069-4484-ad34-7f76ae136231 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:59.505493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dbb373ea-c069-4484-ad34-7f76ae136231 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:59.506196 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dbb373ea-c069-4484-ad34-7f76ae136231 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:59.507298 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dbb373ea-c069-4484-ad34-7f76ae136231 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:27:59.507887 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dbb373ea-c069-4484-ad34-7f76ae136231 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:27:59.942098 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-dbb373ea-c069-4484-ad34-7f76ae136231 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:27:59.968780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b534d3ef-ba60-495b-8d5c-c9a43acf2065 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:27:59.970261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b534d3ef-ba60-495b-8d5c-c9a43acf2065 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:27:59.990246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-dbb373ea-c069-4484-ad34-7f76ae136231 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.494959 Feb 21 02:27:59.991243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 40/97] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:59 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:00.004683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-ba60-495b-8d5c-c9a43acf2065 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:00.007118 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-ba60-495b-8d5c-c9a43acf2065 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:00.008747 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-ba60-495b-8d5c-c9a43acf2065 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:00.011341 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b534d3ef-ba60-495b-8d5c-c9a43acf2065 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:00.193002 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5365327d-d097-425f-89f5-738825dea5f3 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:00.193924 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5365327d-d097-425f-89f5-738825dea5f3 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:00.201981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5365327d-d097-425f-89f5-738825dea5f3 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:00.202825 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5365327d-d097-425f-89f5-738825dea5f3 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:00.203813 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5365327d-d097-425f-89f5-738825dea5f3 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:00.204597 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5365327d-d097-425f-89f5-738825dea5f3 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:00.271397 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b534d3ef-ba60-495b-8d5c-c9a43acf2065 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:00.279258 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b534d3ef-ba60-495b-8d5c-c9a43acf2065 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.326864 Feb 21 02:28:00.279976 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 58/98] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:27:59 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:00.286784 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-557c841d-a377-4c70-9fba-1b729e5e904f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:00.287710 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-557c841d-a377-4c70-9fba-1b729e5e904f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:00.294260 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-557c841d-a377-4c70-9fba-1b729e5e904f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:00.295033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-557c841d-a377-4c70-9fba-1b729e5e904f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:00.296129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-557c841d-a377-4c70-9fba-1b729e5e904f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:00.296783 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-557c841d-a377-4c70-9fba-1b729e5e904f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:00.487267 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5365327d-d097-425f-89f5-738825dea5f3 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:00.495989 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5365327d-d097-425f-89f5-738825dea5f3 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.306344 Feb 21 02:28:00.498551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 41/99] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:00 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:00.523105 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-557c841d-a377-4c70-9fba-1b729e5e904f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:00.531124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-557c841d-a377-4c70-9fba-1b729e5e904f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.248598 Feb 21 02:28:00.531702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 59/100] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:00 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:01.007044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-efb38bc5-1360-4f64-aad4-e3574edbe5f7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:01.007713 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-efb38bc5-1360-4f64-aad4-e3574edbe5f7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:01.018844 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efb38bc5-1360-4f64-aad4-e3574edbe5f7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:01.019523 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efb38bc5-1360-4f64-aad4-e3574edbe5f7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:01.020878 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efb38bc5-1360-4f64-aad4-e3574edbe5f7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:01.022121 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efb38bc5-1360-4f64-aad4-e3574edbe5f7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:01.305958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9ed60694-c6ae-46c2-bc5c-fb175f4c5b0a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:01.307357 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9ed60694-c6ae-46c2-bc5c-fb175f4c5b0a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:01.322612 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9ed60694-c6ae-46c2-bc5c-fb175f4c5b0a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:01.323078 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9ed60694-c6ae-46c2-bc5c-fb175f4c5b0a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:01.323878 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9ed60694-c6ae-46c2-bc5c-fb175f4c5b0a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:01.328734 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9ed60694-c6ae-46c2-bc5c-fb175f4c5b0a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:01.381157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-efb38bc5-1360-4f64-aad4-e3574edbe5f7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:01.390976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-efb38bc5-1360-4f64-aad4-e3574edbe5f7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.387886 Feb 21 02:28:01.394558 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 42/101] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:01 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:01.515668 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-893e9929-5423-4da2-bfb1-eb8191e2cfe5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:01.516267 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-893e9929-5423-4da2-bfb1-eb8191e2cfe5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:01.526838 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-893e9929-5423-4da2-bfb1-eb8191e2cfe5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:01.527999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-893e9929-5423-4da2-bfb1-eb8191e2cfe5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:01.530079 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-893e9929-5423-4da2-bfb1-eb8191e2cfe5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:01.531433 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-893e9929-5423-4da2-bfb1-eb8191e2cfe5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:01.769017 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-893e9929-5423-4da2-bfb1-eb8191e2cfe5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:01.781940 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-893e9929-5423-4da2-bfb1-eb8191e2cfe5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.266972 Feb 21 02:28:01.782779 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 43/102] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:01 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:01.788645 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-27168dbd-1440-4fa3-bfd2-0263f6b2f29c tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:01.789474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-27168dbd-1440-4fa3-bfd2-0263f6b2f29c tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:01.809306 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27168dbd-1440-4fa3-bfd2-0263f6b2f29c tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:01.811192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27168dbd-1440-4fa3-bfd2-0263f6b2f29c tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:01.814783 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27168dbd-1440-4fa3-bfd2-0263f6b2f29c tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:01.816012 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27168dbd-1440-4fa3-bfd2-0263f6b2f29c tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:01.888323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9ed60694-c6ae-46c2-bc5c-fb175f4c5b0a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:01.896340 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9ed60694-c6ae-46c2-bc5c-fb175f4c5b0a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.603276 Feb 21 02:28:01.910046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 60/103] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:01 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:02.015242 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-27168dbd-1440-4fa3-bfd2-0263f6b2f29c tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:02.023813 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-27168dbd-1440-4fa3-bfd2-0263f6b2f29c tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.239552 Feb 21 02:28:02.025275 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 44/104] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:01 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:02.415257 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d645fcac-c0ab-47ed-8ae4-71cfbcd3167a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:02.416045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d645fcac-c0ab-47ed-8ae4-71cfbcd3167a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:02.423266 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d645fcac-c0ab-47ed-8ae4-71cfbcd3167a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:02.423820 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d645fcac-c0ab-47ed-8ae4-71cfbcd3167a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:02.424830 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d645fcac-c0ab-47ed-8ae4-71cfbcd3167a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:02.425470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d645fcac-c0ab-47ed-8ae4-71cfbcd3167a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:02.650851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d645fcac-c0ab-47ed-8ae4-71cfbcd3167a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:02.662033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d645fcac-c0ab-47ed-8ae4-71cfbcd3167a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.253345 Feb 21 02:28:02.663153 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 61/105] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:02 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:02.799674 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-84752256-f0f5-422f-bd06-7daa1e4176b0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:02.800878 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-84752256-f0f5-422f-bd06-7daa1e4176b0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:02.808293 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-84752256-f0f5-422f-bd06-7daa1e4176b0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:02.808940 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-84752256-f0f5-422f-bd06-7daa1e4176b0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:02.809898 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-84752256-f0f5-422f-bd06-7daa1e4176b0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:02.810476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-84752256-f0f5-422f-bd06-7daa1e4176b0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:02.913953 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-712cf5e7-5415-4c71-b7ef-a85fa22a5c5c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:02.914565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-712cf5e7-5415-4c71-b7ef-a85fa22a5c5c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:02.925390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-712cf5e7-5415-4c71-b7ef-a85fa22a5c5c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:02.927398 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-712cf5e7-5415-4c71-b7ef-a85fa22a5c5c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:02.928997 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-712cf5e7-5415-4c71-b7ef-a85fa22a5c5c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:02.929894 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-712cf5e7-5415-4c71-b7ef-a85fa22a5c5c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:03.022364 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-84752256-f0f5-422f-bd06-7daa1e4176b0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:03.032276 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-84752256-f0f5-422f-bd06-7daa1e4176b0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.233682 Feb 21 02:28:03.033122 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 45/106] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:02 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:03.044529 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d72b91f0-8c76-4f06-ba70-ddf94ae1eb7a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:03.045436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d72b91f0-8c76-4f06-ba70-ddf94ae1eb7a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:03.057482 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d72b91f0-8c76-4f06-ba70-ddf94ae1eb7a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:03.059354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d72b91f0-8c76-4f06-ba70-ddf94ae1eb7a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:03.063237 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d72b91f0-8c76-4f06-ba70-ddf94ae1eb7a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:03.063764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d72b91f0-8c76-4f06-ba70-ddf94ae1eb7a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:03.095601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-712cf5e7-5415-4c71-b7ef-a85fa22a5c5c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:03.104698 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-712cf5e7-5415-4c71-b7ef-a85fa22a5c5c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.195401 Feb 21 02:28:03.116408 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 62/107] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:02 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:03.268837 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d72b91f0-8c76-4f06-ba70-ddf94ae1eb7a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:03.282432 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d72b91f0-8c76-4f06-ba70-ddf94ae1eb7a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.244451 Feb 21 02:28:03.294377 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 46/108] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:03 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:03.679667 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ae38bf46-4c64-475b-a3c8-c538c59ebdc3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:03.681104 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ae38bf46-4c64-475b-a3c8-c538c59ebdc3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:03.691236 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae38bf46-4c64-475b-a3c8-c538c59ebdc3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:03.692477 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae38bf46-4c64-475b-a3c8-c538c59ebdc3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:03.694158 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae38bf46-4c64-475b-a3c8-c538c59ebdc3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:03.694833 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae38bf46-4c64-475b-a3c8-c538c59ebdc3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:03.893446 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ae38bf46-4c64-475b-a3c8-c538c59ebdc3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:03.903948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ae38bf46-4c64-475b-a3c8-c538c59ebdc3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.228632 Feb 21 02:28:03.915477 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 63/109] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:03 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:04.052679 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-51881302-2c73-46de-896a-f79038cadcc0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:04.053284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-51881302-2c73-46de-896a-f79038cadcc0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:04.068161 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-51881302-2c73-46de-896a-f79038cadcc0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:04.068898 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-51881302-2c73-46de-896a-f79038cadcc0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:04.069806 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-51881302-2c73-46de-896a-f79038cadcc0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:04.070519 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-51881302-2c73-46de-896a-f79038cadcc0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:04.123955 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d5de03a2-d812-40ee-ac6f-427b56c48526 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:04.124740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d5de03a2-d812-40ee-ac6f-427b56c48526 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:04.136035 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d5de03a2-d812-40ee-ac6f-427b56c48526 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:04.136496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d5de03a2-d812-40ee-ac6f-427b56c48526 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:04.137486 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d5de03a2-d812-40ee-ac6f-427b56c48526 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:04.138506 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d5de03a2-d812-40ee-ac6f-427b56c48526 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:04.257499 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-51881302-2c73-46de-896a-f79038cadcc0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:04.266302 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-51881302-2c73-46de-896a-f79038cadcc0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.218898 Feb 21 02:28:04.266949 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 47/110] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:04 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:04.302121 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9b8303ce-54cf-45e0-ad10-34acc6e74c12 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:04.302943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9b8303ce-54cf-45e0-ad10-34acc6e74c12 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:04.309947 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b8303ce-54cf-45e0-ad10-34acc6e74c12 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:04.310574 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b8303ce-54cf-45e0-ad10-34acc6e74c12 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:04.311890 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b8303ce-54cf-45e0-ad10-34acc6e74c12 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:04.313076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b8303ce-54cf-45e0-ad10-34acc6e74c12 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:04.319500 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d5de03a2-d812-40ee-ac6f-427b56c48526 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:04.329808 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d5de03a2-d812-40ee-ac6f-427b56c48526 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.208680 Feb 21 02:28:04.342141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 64/111] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:04 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:04.483440 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9b8303ce-54cf-45e0-ad10-34acc6e74c12 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:04.493766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9b8303ce-54cf-45e0-ad10-34acc6e74c12 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.197258 Feb 21 02:28:04.494852 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 48/112] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:04 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:04.922932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-79573425-fb3e-43da-bb4b-9a4fae2589a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:04.923670 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-79573425-fb3e-43da-bb4b-9a4fae2589a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:04.935659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-79573425-fb3e-43da-bb4b-9a4fae2589a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:04.936119 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-79573425-fb3e-43da-bb4b-9a4fae2589a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:04.936925 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-79573425-fb3e-43da-bb4b-9a4fae2589a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:04.937411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-79573425-fb3e-43da-bb4b-9a4fae2589a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:05.132332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-79573425-fb3e-43da-bb4b-9a4fae2589a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:05.142943 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-79573425-fb3e-43da-bb4b-9a4fae2589a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.224519 Feb 21 02:28:05.148886 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 65/113] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:04 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:05.290158 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-38c63d14-13e4-4b4f-b0d1-85e128915895 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:05.291621 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-38c63d14-13e4-4b4f-b0d1-85e128915895 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:05.298876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38c63d14-13e4-4b4f-b0d1-85e128915895 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:05.299600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38c63d14-13e4-4b4f-b0d1-85e128915895 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:05.300533 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38c63d14-13e4-4b4f-b0d1-85e128915895 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:05.301331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38c63d14-13e4-4b4f-b0d1-85e128915895 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:05.346124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-47c49042-fac4-4917-9968-3bc7f3e7811a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:05.346731 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-47c49042-fac4-4917-9968-3bc7f3e7811a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:05.355798 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-47c49042-fac4-4917-9968-3bc7f3e7811a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:05.356729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-47c49042-fac4-4917-9968-3bc7f3e7811a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:05.357895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-47c49042-fac4-4917-9968-3bc7f3e7811a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:05.358792 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-47c49042-fac4-4917-9968-3bc7f3e7811a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:05.542963 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-38c63d14-13e4-4b4f-b0d1-85e128915895 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:05.550597 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-38c63d14-13e4-4b4f-b0d1-85e128915895 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.271348 Feb 21 02:28:05.552575 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 49/114] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:05 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:05.557589 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fed19d60-d30f-4ce7-81ac-8b991436bc45 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:05.558401 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fed19d60-d30f-4ce7-81ac-8b991436bc45 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:05.565314 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fed19d60-d30f-4ce7-81ac-8b991436bc45 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:05.568314 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fed19d60-d30f-4ce7-81ac-8b991436bc45 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:05.570258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fed19d60-d30f-4ce7-81ac-8b991436bc45 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:05.572252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-47c49042-fac4-4917-9968-3bc7f3e7811a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:05.573388 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fed19d60-d30f-4ce7-81ac-8b991436bc45 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:05.583578 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-47c49042-fac4-4917-9968-3bc7f3e7811a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.240300 Feb 21 02:28:05.584714 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 66/115] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:05 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:05.744660 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fed19d60-d30f-4ce7-81ac-8b991436bc45 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:05.754987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fed19d60-d30f-4ce7-81ac-8b991436bc45 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.200021 Feb 21 02:28:05.756399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 50/116] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:05 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:06.166704 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-548fdf8d-3e59-4543-888e-35929e4b7265 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:06.168151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-548fdf8d-3e59-4543-888e-35929e4b7265 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:06.177865 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-548fdf8d-3e59-4543-888e-35929e4b7265 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:06.178580 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-548fdf8d-3e59-4543-888e-35929e4b7265 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:06.179393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-548fdf8d-3e59-4543-888e-35929e4b7265 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:06.179810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-548fdf8d-3e59-4543-888e-35929e4b7265 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:06.400803 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-548fdf8d-3e59-4543-888e-35929e4b7265 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:06.417324 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-548fdf8d-3e59-4543-888e-35929e4b7265 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.255290 Feb 21 02:28:06.420175 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 67/117] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:06 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:06.568897 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8f012a2b-c737-441b-ac86-e640f14aa4dd tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:06.570633 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8f012a2b-c737-441b-ac86-e640f14aa4dd tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:06.585852 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8f012a2b-c737-441b-ac86-e640f14aa4dd tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:06.588920 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8f012a2b-c737-441b-ac86-e640f14aa4dd tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:06.591215 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8f012a2b-c737-441b-ac86-e640f14aa4dd tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:06.591664 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8f012a2b-c737-441b-ac86-e640f14aa4dd tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:06.602095 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-340f683b-0ba5-4a2f-aa8e-0683ff213acc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:06.602715 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-340f683b-0ba5-4a2f-aa8e-0683ff213acc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:06.615319 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-340f683b-0ba5-4a2f-aa8e-0683ff213acc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:06.615793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-340f683b-0ba5-4a2f-aa8e-0683ff213acc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:06.616600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-340f683b-0ba5-4a2f-aa8e-0683ff213acc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:06.619749 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-340f683b-0ba5-4a2f-aa8e-0683ff213acc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:06.762458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8f012a2b-c737-441b-ac86-e640f14aa4dd tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:06.775748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8f012a2b-c737-441b-ac86-e640f14aa4dd tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.211097 Feb 21 02:28:06.776771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 51/118] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:06 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:06.783527 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-10f1414e-5e3f-4622-b2b1-0e9e429c5333 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:06.784790 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-10f1414e-5e3f-4622-b2b1-0e9e429c5333 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:06.792563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-10f1414e-5e3f-4622-b2b1-0e9e429c5333 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:06.793269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-10f1414e-5e3f-4622-b2b1-0e9e429c5333 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:06.794073 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-10f1414e-5e3f-4622-b2b1-0e9e429c5333 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:06.794647 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-10f1414e-5e3f-4622-b2b1-0e9e429c5333 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:06.810933 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-340f683b-0ba5-4a2f-aa8e-0683ff213acc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:06.819499 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-340f683b-0ba5-4a2f-aa8e-0683ff213acc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.222888 Feb 21 02:28:06.829013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 68/119] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:06 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:06.950735 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-10f1414e-5e3f-4622-b2b1-0e9e429c5333 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:06.959629 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-10f1414e-5e3f-4622-b2b1-0e9e429c5333 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.181509 Feb 21 02:28:06.960199 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 52/120] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:06 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:07.434380 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9612e28e-b098-4a4a-9f86-3d3ae6a65fba tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:07.434981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9612e28e-b098-4a4a-9f86-3d3ae6a65fba tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:07.445329 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9612e28e-b098-4a4a-9f86-3d3ae6a65fba tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:07.446071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9612e28e-b098-4a4a-9f86-3d3ae6a65fba tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:07.447541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9612e28e-b098-4a4a-9f86-3d3ae6a65fba tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:07.448446 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9612e28e-b098-4a4a-9f86-3d3ae6a65fba tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:07.671248 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9612e28e-b098-4a4a-9f86-3d3ae6a65fba tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:07.680904 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9612e28e-b098-4a4a-9f86-3d3ae6a65fba tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.249806 Feb 21 02:28:07.682119 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 69/121] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:07 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:07.794176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9acc9a63-d654-467a-ad0e-f149f29fa9a2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:07.794981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9acc9a63-d654-467a-ad0e-f149f29fa9a2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:07.809587 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9acc9a63-d654-467a-ad0e-f149f29fa9a2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:07.810797 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9acc9a63-d654-467a-ad0e-f149f29fa9a2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:07.813238 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9acc9a63-d654-467a-ad0e-f149f29fa9a2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:07.814444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9acc9a63-d654-467a-ad0e-f149f29fa9a2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:07.837245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c17729e2-b1bd-4831-9442-4e5955c1f64c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:07.838322 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c17729e2-b1bd-4831-9442-4e5955c1f64c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:07.863212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c17729e2-b1bd-4831-9442-4e5955c1f64c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:07.864549 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c17729e2-b1bd-4831-9442-4e5955c1f64c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:07.868811 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c17729e2-b1bd-4831-9442-4e5955c1f64c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:07.870682 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c17729e2-b1bd-4831-9442-4e5955c1f64c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:08.138213 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9acc9a63-d654-467a-ad0e-f149f29fa9a2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:08.146250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9acc9a63-d654-467a-ad0e-f149f29fa9a2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.356740 Feb 21 02:28:08.146930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 53/122] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:07 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:08.186261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c17729e2-b1bd-4831-9442-4e5955c1f64c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:08.194724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c17729e2-b1bd-4831-9442-4e5955c1f64c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.361832 Feb 21 02:28:08.203948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 70/123] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:07 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:08.203948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f7855643-f372-4f41-964d-a12a91b1f143 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:08.203948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f7855643-f372-4f41-964d-a12a91b1f143 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:08.209152 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7855643-f372-4f41-964d-a12a91b1f143 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:08.210180 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7855643-f372-4f41-964d-a12a91b1f143 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:08.211103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7855643-f372-4f41-964d-a12a91b1f143 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:08.211596 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7855643-f372-4f41-964d-a12a91b1f143 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:08.339806 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-b9dc29e6-f5f7-491e-83ee-7f96bbe4e415 req-347ffa11-ef19-4172-a6e8-e6c4e7c769ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57db8fe7-822f-4654-af4d-f883ba203764", "name": "network-vif-plugged", "status": "completed", "tag": "564ee339-f6a7-4482-9e82-3e4945304a7c"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:08.342568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:28:08.342568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:28:08.360500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-b9dc29e6-f5f7-491e-83ee-7f96bbe4e415 req-347ffa11-ef19-4172-a6e8-e6c4e7c769ca service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:08.361153 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-b9dc29e6-f5f7-491e-83ee-7f96bbe4e415 req-347ffa11-ef19-4172-a6e8-e6c4e7c769ca service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:08.391663 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-b9dc29e6-f5f7-491e-83ee-7f96bbe4e415 req-347ffa11-ef19-4172-a6e8-e6c4e7c769ca service nova] Creating event network-vif-plugged:564ee339-f6a7-4482-9e82-3e4945304a7c for instance 57db8fe7-822f-4654-af4d-f883ba203764 on hv-cinder-80447 Feb 21 02:28:08.396434 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f7855643-f372-4f41-964d-a12a91b1f143 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:08.397533 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-b9dc29e6-f5f7-491e-83ee-7f96bbe4e415 req-347ffa11-ef19-4172-a6e8-e6c4e7c769ca service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239965 Feb 21 02:28:08.399766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 54/124] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:08.404114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f7855643-f372-4f41-964d-a12a91b1f143 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.206797 Feb 21 02:28:08.404679 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 71/125] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:08 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:08.699721 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4b47c04a-8814-45f1-9753-5a7b9af27545 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:08.700426 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4b47c04a-8814-45f1-9753-5a7b9af27545 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:08.720270 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4b47c04a-8814-45f1-9753-5a7b9af27545 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:08.735717 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4b47c04a-8814-45f1-9753-5a7b9af27545 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:08.740808 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4b47c04a-8814-45f1-9753-5a7b9af27545 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:08.742296 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4b47c04a-8814-45f1-9753-5a7b9af27545 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:09.065105 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4b47c04a-8814-45f1-9753-5a7b9af27545 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:09.074034 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4b47c04a-8814-45f1-9753-5a7b9af27545 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.379150 Feb 21 02:28:09.075319 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 55/126] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:08 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:09.164734 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f7ba394f-baa4-4ae9-ab85-5c293a631b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:09.165343 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f7ba394f-baa4-4ae9-ab85-5c293a631b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:09.174829 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7ba394f-baa4-4ae9-ab85-5c293a631b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:09.175274 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7ba394f-baa4-4ae9-ab85-5c293a631b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:09.176111 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7ba394f-baa4-4ae9-ab85-5c293a631b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:09.176785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7ba394f-baa4-4ae9-ab85-5c293a631b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:09.214915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d870b291-4638-43cc-839f-d2c993ae89c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:09.215695 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d870b291-4638-43cc-839f-d2c993ae89c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:09.227602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d870b291-4638-43cc-839f-d2c993ae89c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:09.228942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d870b291-4638-43cc-839f-d2c993ae89c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:09.231391 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d870b291-4638-43cc-839f-d2c993ae89c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:09.232017 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d870b291-4638-43cc-839f-d2c993ae89c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:09.399706 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f7ba394f-baa4-4ae9-ab85-5c293a631b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:09.410878 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f7ba394f-baa4-4ae9-ab85-5c293a631b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.250669 Feb 21 02:28:09.411826 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 72/127] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:09 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:09.421194 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6336623c-5e15-40e6-bc66-73f861f143d1 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:09.422037 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6336623c-5e15-40e6-bc66-73f861f143d1 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:09.428579 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6336623c-5e15-40e6-bc66-73f861f143d1 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:09.429028 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6336623c-5e15-40e6-bc66-73f861f143d1 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:09.430064 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6336623c-5e15-40e6-bc66-73f861f143d1 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:09.430319 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6336623c-5e15-40e6-bc66-73f861f143d1 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:09.532900 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d870b291-4638-43cc-839f-d2c993ae89c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:09.542088 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d870b291-4638-43cc-839f-d2c993ae89c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.334777 Feb 21 02:28:09.543031 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 56/128] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:09 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:09.603418 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6336623c-5e15-40e6-bc66-73f861f143d1 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:09.610872 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6336623c-5e15-40e6-bc66-73f861f143d1 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.193290 Feb 21 02:28:09.611519 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 73/129] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:09 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:10.091158 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-39a5a227-8adf-463a-bdbd-879cc876752f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:10.091761 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-39a5a227-8adf-463a-bdbd-879cc876752f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:10.097540 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39a5a227-8adf-463a-bdbd-879cc876752f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.098574 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39a5a227-8adf-463a-bdbd-879cc876752f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.099427 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39a5a227-8adf-463a-bdbd-879cc876752f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.099863 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39a5a227-8adf-463a-bdbd-879cc876752f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.230423 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-39a5a227-8adf-463a-bdbd-879cc876752f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:10.238071 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-39a5a227-8adf-463a-bdbd-879cc876752f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.150533 Feb 21 02:28:10.239254 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 57/130] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:10 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:10.428153 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-38d9c5b1-df70-45c6-8e17-fbd2abbc75a6 req-a3bfb9e7-4865-436a-8e5c-830c58855a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af65eb3-dbe6-4a66-919e-c8a6884b613c", "name": "network-vif-plugged", "status": "completed", "tag": "754d6b40-0964-484e-9d3d-46275c69f4cb"}, {"server_uuid": "8aeae50f-fa12-4250-8e53-9a5fcdded6d3", "name": "network-vif-plugged", "status": "completed", "tag": "71ba9208-2448-4764-bb34-2672da8a2c21"}, {"server_uuid": "f2034fae-347a-4500-8cbf-606b03dcfcc5", "name": "network-vif-plugged", "status": "completed", "tag": "2460a313-d85b-438c-8bd0-f46e5ebbd9ff"}, {"server_uuid": "c909020c-1e47-4a5c-826f-c8d88b2c7a05", "name": "network-vif-plugged", "status": "completed", "tag": "10b7d237-63f4-46b8-9fb5-022ff16a013d"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:10.430148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:28:10.430148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:28:10.430929 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-269a2c22-3243-49fd-b24b-50edcd4b3486 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:10.431536 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-269a2c22-3243-49fd-b24b-50edcd4b3486 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:10.437691 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-269a2c22-3243-49fd-b24b-50edcd4b3486 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.438136 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-269a2c22-3243-49fd-b24b-50edcd4b3486 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.438907 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-269a2c22-3243-49fd-b24b-50edcd4b3486 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.439110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-38d9c5b1-df70-45c6-8e17-fbd2abbc75a6 req-a3bfb9e7-4865-436a-8e5c-830c58855a5f service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.439332 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-269a2c22-3243-49fd-b24b-50edcd4b3486 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.439557 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-38d9c5b1-df70-45c6-8e17-fbd2abbc75a6 req-a3bfb9e7-4865-436a-8e5c-830c58855a5f service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.455427 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-38d9c5b1-df70-45c6-8e17-fbd2abbc75a6 req-a3bfb9e7-4865-436a-8e5c-830c58855a5f service nova] Creating event network-vif-plugged:754d6b40-0964-484e-9d3d-46275c69f4cb for instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c on hv-cinder-80447 Feb 21 02:28:10.455952 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-38d9c5b1-df70-45c6-8e17-fbd2abbc75a6 req-a3bfb9e7-4865-436a-8e5c-830c58855a5f service nova] Creating event network-vif-plugged:71ba9208-2448-4764-bb34-2672da8a2c21 for instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 on hv-cinder-80447 Feb 21 02:28:10.456444 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-38d9c5b1-df70-45c6-8e17-fbd2abbc75a6 req-a3bfb9e7-4865-436a-8e5c-830c58855a5f service nova] Creating event network-vif-plugged:2460a313-d85b-438c-8bd0-f46e5ebbd9ff for instance f2034fae-347a-4500-8cbf-606b03dcfcc5 on hv-cinder-80447 Feb 21 02:28:10.456937 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-38d9c5b1-df70-45c6-8e17-fbd2abbc75a6 req-a3bfb9e7-4865-436a-8e5c-830c58855a5f service nova] Creating event network-vif-plugged:10b7d237-63f4-46b8-9fb5-022ff16a013d for instance c909020c-1e47-4a5c-826f-c8d88b2c7a05 on hv-cinder-80447 Feb 21 02:28:10.467664 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-38d9c5b1-df70-45c6-8e17-fbd2abbc75a6 req-a3bfb9e7-4865-436a-8e5c-830c58855a5f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.043051 Feb 21 02:28:10.468179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 74/131] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:10.560586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dfd5d109-0be7-4f27-b57f-ff7ac2c74b03 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:10.561443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dfd5d109-0be7-4f27-b57f-ff7ac2c74b03 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:10.574433 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dfd5d109-0be7-4f27-b57f-ff7ac2c74b03 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.575077 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dfd5d109-0be7-4f27-b57f-ff7ac2c74b03 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.576161 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dfd5d109-0be7-4f27-b57f-ff7ac2c74b03 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.576931 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dfd5d109-0be7-4f27-b57f-ff7ac2c74b03 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.591430 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-269a2c22-3243-49fd-b24b-50edcd4b3486 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:10.600057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-269a2c22-3243-49fd-b24b-50edcd4b3486 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.175637 Feb 21 02:28:10.600706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 58/132] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:10 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:10.629222 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-967d65a3-287e-4ce3-95c3-a704bef95d84 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:10.630632 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-967d65a3-287e-4ce3-95c3-a704bef95d84 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:10.645675 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-967d65a3-287e-4ce3-95c3-a704bef95d84 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.646451 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-967d65a3-287e-4ce3-95c3-a704bef95d84 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.647273 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-967d65a3-287e-4ce3-95c3-a704bef95d84 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:10.647713 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-967d65a3-287e-4ce3-95c3-a704bef95d84 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:10.824511 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-dfd5d109-0be7-4f27-b57f-ff7ac2c74b03 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:10.843968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dfd5d109-0be7-4f27-b57f-ff7ac2c74b03 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.288275 Feb 21 02:28:10.844458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 75/133] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:10 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:10.992595 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-967d65a3-287e-4ce3-95c3-a704bef95d84 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:11.006088 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-967d65a3-287e-4ce3-95c3-a704bef95d84 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1314 microversion: 2.1 time: 0.381616 Feb 21 02:28:11.023544 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 59/134] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:10 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:11.256183 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8f3eeb5b-a214-49ef-8828-f1f459a43b30 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:11.256794 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8f3eeb5b-a214-49ef-8828-f1f459a43b30 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:11.262708 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8f3eeb5b-a214-49ef-8828-f1f459a43b30 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:11.263337 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8f3eeb5b-a214-49ef-8828-f1f459a43b30 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:11.264305 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8f3eeb5b-a214-49ef-8828-f1f459a43b30 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:11.264738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8f3eeb5b-a214-49ef-8828-f1f459a43b30 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:11.415664 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8f3eeb5b-a214-49ef-8828-f1f459a43b30 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:11.427839 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8f3eeb5b-a214-49ef-8828-f1f459a43b30 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.175442 Feb 21 02:28:11.429416 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 76/135] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:11 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:11.620356 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ba25643a-33de-4327-8647-b6d890d93a95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:11.621041 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ba25643a-33de-4327-8647-b6d890d93a95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:11.626842 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba25643a-33de-4327-8647-b6d890d93a95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:11.627351 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba25643a-33de-4327-8647-b6d890d93a95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:11.628296 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba25643a-33de-4327-8647-b6d890d93a95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:11.628721 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba25643a-33de-4327-8647-b6d890d93a95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:11.765917 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ba25643a-33de-4327-8647-b6d890d93a95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:11.774939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ba25643a-33de-4327-8647-b6d890d93a95 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.158060 Feb 21 02:28:11.775516 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 60/136] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:11 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:11.862157 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d44565a5-214d-49bf-984b-31f60368c3cc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:11.862769 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d44565a5-214d-49bf-984b-31f60368c3cc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:11.868738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d44565a5-214d-49bf-984b-31f60368c3cc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:11.869180 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d44565a5-214d-49bf-984b-31f60368c3cc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:11.869973 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d44565a5-214d-49bf-984b-31f60368c3cc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:11.870406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d44565a5-214d-49bf-984b-31f60368c3cc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:12.027676 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e67d51a7-e527-4cf9-8764-caf45024fded tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:12.028362 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e67d51a7-e527-4cf9-8764-caf45024fded tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:12.034600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e67d51a7-e527-4cf9-8764-caf45024fded tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:12.035087 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e67d51a7-e527-4cf9-8764-caf45024fded tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:12.036524 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e67d51a7-e527-4cf9-8764-caf45024fded tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:12.037003 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e67d51a7-e527-4cf9-8764-caf45024fded tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:12.068954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d44565a5-214d-49bf-984b-31f60368c3cc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:12.076643 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d44565a5-214d-49bf-984b-31f60368c3cc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.218354 Feb 21 02:28:12.077416 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 77/137] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:11 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:12.180122 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e67d51a7-e527-4cf9-8764-caf45024fded tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:12.187461 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e67d51a7-e527-4cf9-8764-caf45024fded tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1501 microversion: 2.1 time: 0.163880 Feb 21 02:28:12.188037 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 61/138] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:12 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:12.460599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6f5e99cb-037e-45f3-99bf-0221b605a6b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:12.460599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6f5e99cb-037e-45f3-99bf-0221b605a6b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:12.476349 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f5e99cb-037e-45f3-99bf-0221b605a6b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:12.477746 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f5e99cb-037e-45f3-99bf-0221b605a6b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:12.478608 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f5e99cb-037e-45f3-99bf-0221b605a6b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:12.479058 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f5e99cb-037e-45f3-99bf-0221b605a6b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:12.635071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6f5e99cb-037e-45f3-99bf-0221b605a6b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:12.642565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6f5e99cb-037e-45f3-99bf-0221b605a6b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.200942 Feb 21 02:28:12.643140 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 78/139] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:12 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:12.792249 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ca9dacf4-9281-45b9-b716-6bfb8b8cd7bf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:12.792778 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ca9dacf4-9281-45b9-b716-6bfb8b8cd7bf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:12.798838 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca9dacf4-9281-45b9-b716-6bfb8b8cd7bf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:12.799292 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca9dacf4-9281-45b9-b716-6bfb8b8cd7bf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:12.800067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca9dacf4-9281-45b9-b716-6bfb8b8cd7bf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:12.800497 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca9dacf4-9281-45b9-b716-6bfb8b8cd7bf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:12.942822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ca9dacf4-9281-45b9-b716-6bfb8b8cd7bf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:12.950448 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ca9dacf4-9281-45b9-b716-6bfb8b8cd7bf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.161884 Feb 21 02:28:12.951143 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 62/140] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:12 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:13.094180 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d775d999-652e-479c-ac41-933c851d59a9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:13.094760 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d775d999-652e-479c-ac41-933c851d59a9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:13.100468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d775d999-652e-479c-ac41-933c851d59a9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:13.100904 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d775d999-652e-479c-ac41-933c851d59a9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:13.101684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d775d999-652e-479c-ac41-933c851d59a9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:13.102114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d775d999-652e-479c-ac41-933c851d59a9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:13.290947 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d775d999-652e-479c-ac41-933c851d59a9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:13.298857 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d775d999-652e-479c-ac41-933c851d59a9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.207977 Feb 21 02:28:13.299533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 79/141] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:13 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:13.659970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b0fe6b04-ca55-4427-9a21-cc6ea521657b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:13.661439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b0fe6b04-ca55-4427-9a21-cc6ea521657b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:13.667375 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0fe6b04-ca55-4427-9a21-cc6ea521657b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:13.667849 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0fe6b04-ca55-4427-9a21-cc6ea521657b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:13.668626 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0fe6b04-ca55-4427-9a21-cc6ea521657b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:13.669085 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0fe6b04-ca55-4427-9a21-cc6ea521657b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:13.806213 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b0fe6b04-ca55-4427-9a21-cc6ea521657b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:13.813555 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b0fe6b04-ca55-4427-9a21-cc6ea521657b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.157214 Feb 21 02:28:13.814334 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 63/142] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:13 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:13.967837 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e891f895-27b7-4ebb-9af6-0bd2dc5b64b9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:13.968446 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e891f895-27b7-4ebb-9af6-0bd2dc5b64b9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:13.975517 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e891f895-27b7-4ebb-9af6-0bd2dc5b64b9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:13.975960 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e891f895-27b7-4ebb-9af6-0bd2dc5b64b9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:13.976730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e891f895-27b7-4ebb-9af6-0bd2dc5b64b9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:13.977157 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e891f895-27b7-4ebb-9af6-0bd2dc5b64b9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:14.122497 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e891f895-27b7-4ebb-9af6-0bd2dc5b64b9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:14.129815 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e891f895-27b7-4ebb-9af6-0bd2dc5b64b9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.165556 Feb 21 02:28:14.130440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 80/143] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:13 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:14.315884 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d67e6717-70c6-4785-95fc-5dc09f98452c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:14.316405 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d67e6717-70c6-4785-95fc-5dc09f98452c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:14.322135 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d67e6717-70c6-4785-95fc-5dc09f98452c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:14.322575 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d67e6717-70c6-4785-95fc-5dc09f98452c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:14.323342 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d67e6717-70c6-4785-95fc-5dc09f98452c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:14.323766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d67e6717-70c6-4785-95fc-5dc09f98452c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:14.463265 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d67e6717-70c6-4785-95fc-5dc09f98452c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:14.472620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d67e6717-70c6-4785-95fc-5dc09f98452c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.159945 Feb 21 02:28:14.473487 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 64/144] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:14 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:14.830299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-31ebaea3-d4d0-4ede-9ceb-ce2750def9f4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:14.830824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-31ebaea3-d4d0-4ede-9ceb-ce2750def9f4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:14.837381 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-31ebaea3-d4d0-4ede-9ceb-ce2750def9f4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:14.837895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-31ebaea3-d4d0-4ede-9ceb-ce2750def9f4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:14.838846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-31ebaea3-d4d0-4ede-9ceb-ce2750def9f4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:14.839276 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-31ebaea3-d4d0-4ede-9ceb-ce2750def9f4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:14.981739 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-31ebaea3-d4d0-4ede-9ceb-ce2750def9f4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:14.990439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-31ebaea3-d4d0-4ede-9ceb-ce2750def9f4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.163858 Feb 21 02:28:14.991007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 81/145] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:14 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:15.147184 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ca1468ea-bdf9-4425-a59c-1ec0ee99909c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:15.147860 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ca1468ea-bdf9-4425-a59c-1ec0ee99909c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:15.154109 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca1468ea-bdf9-4425-a59c-1ec0ee99909c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:15.154557 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca1468ea-bdf9-4425-a59c-1ec0ee99909c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:15.155340 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca1468ea-bdf9-4425-a59c-1ec0ee99909c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:15.155771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca1468ea-bdf9-4425-a59c-1ec0ee99909c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:15.293917 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ca1468ea-bdf9-4425-a59c-1ec0ee99909c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:15.303427 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ca1468ea-bdf9-4425-a59c-1ec0ee99909c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.160595 Feb 21 02:28:15.304166 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 65/146] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:15 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:15.491472 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-abdbcf79-e427-4f5c-a0d8-7bc2e1fa8843 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:15.492114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-abdbcf79-e427-4f5c-a0d8-7bc2e1fa8843 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:15.498444 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-abdbcf79-e427-4f5c-a0d8-7bc2e1fa8843 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:15.498877 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-abdbcf79-e427-4f5c-a0d8-7bc2e1fa8843 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:15.499802 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-abdbcf79-e427-4f5c-a0d8-7bc2e1fa8843 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:15.500839 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-abdbcf79-e427-4f5c-a0d8-7bc2e1fa8843 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:15.685361 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-abdbcf79-e427-4f5c-a0d8-7bc2e1fa8843 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:15.709757 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-abdbcf79-e427-4f5c-a0d8-7bc2e1fa8843 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.222879 Feb 21 02:28:15.710357 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 82/147] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:15 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:16.009462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a14c0210-0066-43bd-8cf9-9dd5b75b62aa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:16.010378 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a14c0210-0066-43bd-8cf9-9dd5b75b62aa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:16.017764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a14c0210-0066-43bd-8cf9-9dd5b75b62aa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:16.018300 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a14c0210-0066-43bd-8cf9-9dd5b75b62aa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:16.019484 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a14c0210-0066-43bd-8cf9-9dd5b75b62aa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:16.020220 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a14c0210-0066-43bd-8cf9-9dd5b75b62aa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:16.228853 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a14c0210-0066-43bd-8cf9-9dd5b75b62aa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:16.238575 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a14c0210-0066-43bd-8cf9-9dd5b75b62aa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.235029 Feb 21 02:28:16.239152 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 66/148] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:16 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:16.322133 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-01499893-1318-4b5a-9233-b0d9e8968360 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:16.322868 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-01499893-1318-4b5a-9233-b0d9e8968360 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:16.335478 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-01499893-1318-4b5a-9233-b0d9e8968360 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:16.336147 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-01499893-1318-4b5a-9233-b0d9e8968360 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:16.336942 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-01499893-1318-4b5a-9233-b0d9e8968360 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:16.337378 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-01499893-1318-4b5a-9233-b0d9e8968360 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:16.513139 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-01499893-1318-4b5a-9233-b0d9e8968360 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:16.520832 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-01499893-1318-4b5a-9233-b0d9e8968360 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1318 microversion: 2.1 time: 0.204296 Feb 21 02:28:16.521416 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 83/149] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:16 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:16.732848 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3dc2841f-739a-47d8-9a05-c3e53aa52b11 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:16.736840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3dc2841f-739a-47d8-9a05-c3e53aa52b11 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:16.747564 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3dc2841f-739a-47d8-9a05-c3e53aa52b11 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:16.748459 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3dc2841f-739a-47d8-9a05-c3e53aa52b11 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:16.751274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3dc2841f-739a-47d8-9a05-c3e53aa52b11 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:16.751942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3dc2841f-739a-47d8-9a05-c3e53aa52b11 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:16.810604 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b0ee57bd-a594-42f8-bfed-dac25f57524a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b845ab3-6de3-45dc-9868-440a6b0b72a0"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:16.811810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b0ee57bd-a594-42f8-bfed-dac25f57524a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:16.818061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0ee57bd-a594-42f8-bfed-dac25f57524a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:16.818771 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0ee57bd-a594-42f8-bfed-dac25f57524a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:16.819817 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0ee57bd-a594-42f8-bfed-dac25f57524a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:16.820395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0ee57bd-a594-42f8-bfed-dac25f57524a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:16.952613 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3dc2841f-739a-47d8-9a05-c3e53aa52b11 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:16.966513 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3dc2841f-739a-47d8-9a05-c3e53aa52b11 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1363 microversion: 2.1 time: 0.240450 Feb 21 02:28:16.967651 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 67/150] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:16 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:17.257303 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-38b3374c-12cf-4259-bf81-ec800c084084 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:17.257991 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-38b3374c-12cf-4259-bf81-ec800c084084 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:17.264556 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38b3374c-12cf-4259-bf81-ec800c084084 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:17.265420 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38b3374c-12cf-4259-bf81-ec800c084084 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:17.266815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38b3374c-12cf-4259-bf81-ec800c084084 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:17.267625 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38b3374c-12cf-4259-bf81-ec800c084084 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:17.277453 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b0ee57bd-a594-42f8-bfed-dac25f57524a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "POST /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470212 Feb 21 02:28:17.282332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 84/151] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:28:16 2022] POST /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:17.449373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-38b3374c-12cf-4259-bf81-ec800c084084 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:17.463920 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-38b3374c-12cf-4259-bf81-ec800c084084 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1322 microversion: 2.1 time: 0.211343 Feb 21 02:28:17.466003 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 68/152] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:17 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:17.538424 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8e4baa68-7293-4ed9-8f37-1416bc0d423c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:17.539183 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8e4baa68-7293-4ed9-8f37-1416bc0d423c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:17.552277 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8e4baa68-7293-4ed9-8f37-1416bc0d423c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:17.552965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8e4baa68-7293-4ed9-8f37-1416bc0d423c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:17.553610 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8e4baa68-7293-4ed9-8f37-1416bc0d423c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:17.556537 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8e4baa68-7293-4ed9-8f37-1416bc0d423c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:17.721800 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8e4baa68-7293-4ed9-8f37-1416bc0d423c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:17.734651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8e4baa68-7293-4ed9-8f37-1416bc0d423c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1507 microversion: 2.1 time: 0.201285 Feb 21 02:28:17.735406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 85/153] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:17 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:17.984966 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a34224c2-e964-4bff-b58b-67904f873fca tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:17.985588 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a34224c2-e964-4bff-b58b-67904f873fca tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:17.993127 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a34224c2-e964-4bff-b58b-67904f873fca tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:17.993669 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a34224c2-e964-4bff-b58b-67904f873fca tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:17.994478 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a34224c2-e964-4bff-b58b-67904f873fca tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:17.997853 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a34224c2-e964-4bff-b58b-67904f873fca tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:18.173277 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a34224c2-e964-4bff-b58b-67904f873fca tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:18.182232 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a34224c2-e964-4bff-b58b-67904f873fca tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1550 microversion: 2.1 time: 0.201036 Feb 21 02:28:18.192636 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 69/154] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:17 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1550 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:18.201113 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-bcc6e541-7ce5-4f48-8c6e-24a9259a95f6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:18.202147 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-bcc6e541-7ce5-4f48-8c6e-24a9259a95f6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:18.216927 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bcc6e541-7ce5-4f48-8c6e-24a9259a95f6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:18.227459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bcc6e541-7ce5-4f48-8c6e-24a9259a95f6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:18.227459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bcc6e541-7ce5-4f48-8c6e-24a9259a95f6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:18.227459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bcc6e541-7ce5-4f48-8c6e-24a9259a95f6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:18.380013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-bcc6e541-7ce5-4f48-8c6e-24a9259a95f6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183330 Feb 21 02:28:18.381086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 86/155] 10.222.0.75 () {58 vars in 1274 bytes} [Mon Feb 21 02:28:18 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/os-interface => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:18.482670 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-13e551c0-7003-4534-aee3-b0976db0b65a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:18.483338 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-13e551c0-7003-4534-aee3-b0976db0b65a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:18.492439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-13e551c0-7003-4534-aee3-b0976db0b65a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:18.493152 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-13e551c0-7003-4534-aee3-b0976db0b65a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:18.494115 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-13e551c0-7003-4534-aee3-b0976db0b65a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:18.495482 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-13e551c0-7003-4534-aee3-b0976db0b65a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:19.006880 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-13e551c0-7003-4534-aee3-b0976db0b65a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:19.016512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-13e551c0-7003-4534-aee3-b0976db0b65a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1515 microversion: 2.1 time: 0.537531 Feb 21 02:28:19.017091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 70/156] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:18 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1515 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:19.035341 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7e24c599-9a7e-4cbe-86a8-0c1919c8ea7d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:19.037033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7e24c599-9a7e-4cbe-86a8-0c1919c8ea7d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:19.043342 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7e24c599-9a7e-4cbe-86a8-0c1919c8ea7d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:19.043977 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7e24c599-9a7e-4cbe-86a8-0c1919c8ea7d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:19.044906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7e24c599-9a7e-4cbe-86a8-0c1919c8ea7d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:19.045510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7e24c599-9a7e-4cbe-86a8-0c1919c8ea7d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:19.077042 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-7e24c599-9a7e-4cbe-86a8-0c1919c8ea7d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lazy-loading 'flavor' on Instance uuid c909020c-1e47-4a5c-826f-c8d88b2c7a05 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:28:19.416482 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8c731c94-c758-482e-ac13-b51629df099d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2b98e53-a104-4cf0-88a1-b2cadce1bb36"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:19.417896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8c731c94-c758-482e-ac13-b51629df099d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:19.428809 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8c731c94-c758-482e-ac13-b51629df099d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:19.429464 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8c731c94-c758-482e-ac13-b51629df099d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:19.430424 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8c731c94-c758-482e-ac13-b51629df099d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:19.431098 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8c731c94-c758-482e-ac13-b51629df099d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:19.439459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7e24c599-9a7e-4cbe-86a8-0c1919c8ea7d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05/action" status: 200 len: 32 microversion: 2.1 time: 0.408448 Feb 21 02:28:19.451585 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 87/157] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:28:19 2022] POST /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 02:28:19.464253 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1c8d544c-ef8e-43c5-9810-ca6d1b0c0c1e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:19.465443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1c8d544c-ef8e-43c5-9810-ca6d1b0c0c1e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:19.485510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1c8d544c-ef8e-43c5-9810-ca6d1b0c0c1e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:19.486065 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1c8d544c-ef8e-43c5-9810-ca6d1b0c0c1e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:19.486941 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1c8d544c-ef8e-43c5-9810-ca6d1b0c0c1e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:19.487521 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1c8d544c-ef8e-43c5-9810-ca6d1b0c0c1e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:19.776182 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1c8d544c-ef8e-43c5-9810-ca6d1b0c0c1e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:19.783692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1c8d544c-ef8e-43c5-9810-ca6d1b0c0c1e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.330698 Feb 21 02:28:19.785432 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 88/158] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:19 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:19.936569 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8c731c94-c758-482e-ac13-b51629df099d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.520929 Feb 21 02:28:19.941851 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 71/159] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:28:19 2022] POST /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:20.802811 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e061f1a8-6db0-436e-a712-10e5a3e281b5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:20.803736 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e061f1a8-6db0-436e-a712-10e5a3e281b5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:20.813923 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e061f1a8-6db0-436e-a712-10e5a3e281b5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:20.814529 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e061f1a8-6db0-436e-a712-10e5a3e281b5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:20.815541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e061f1a8-6db0-436e-a712-10e5a3e281b5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:20.816901 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e061f1a8-6db0-436e-a712-10e5a3e281b5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:20.866741 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9e8edab4-4142-4d37-95d5-ad1dd0ce40fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:20.867985 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9e8edab4-4142-4d37-95d5-ad1dd0ce40fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:20.880830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e8edab4-4142-4d37-95d5-ad1dd0ce40fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:20.882778 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e8edab4-4142-4d37-95d5-ad1dd0ce40fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:20.890851 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e8edab4-4142-4d37-95d5-ad1dd0ce40fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:20.891769 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e8edab4-4142-4d37-95d5-ad1dd0ce40fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:20.951178 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9e8edab4-4142-4d37-95d5-ad1dd0ce40fc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/ips" status: 200 len: 107 microversion: 2.1 time: 0.089271 Feb 21 02:28:20.955439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 72/160] 10.222.0.75 () {58 vars in 1247 bytes} [Mon Feb 21 02:28:20 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/ips => generated 107 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:20.977800 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-ac5db421-a923-4ec6-a469-59692283c6d9 req-6389fcdf-ebeb-4f07-8dee-7920c1254a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af65eb3-dbe6-4a66-919e-c8a6884b613c", "tag": "754d6b40-0964-484e-9d3d-46275c69f4cb"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:20.979530 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:28:20.979530 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:28:21.000381 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-ac5db421-a923-4ec6-a469-59692283c6d9 req-6389fcdf-ebeb-4f07-8dee-7920c1254a5d service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:21.001258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-ac5db421-a923-4ec6-a469-59692283c6d9 req-6389fcdf-ebeb-4f07-8dee-7920c1254a5d service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:21.058418 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-ac5db421-a923-4ec6-a469-59692283c6d9 req-6389fcdf-ebeb-4f07-8dee-7920c1254a5d service nova] Creating event network-changed:754d6b40-0964-484e-9d3d-46275c69f4cb for instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c on hv-cinder-80447 Feb 21 02:28:21.080208 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-ac5db421-a923-4ec6-a469-59692283c6d9 req-6389fcdf-ebeb-4f07-8dee-7920c1254a5d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121697 Feb 21 02:28:21.081159 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 73/161] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:21.156873 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e061f1a8-6db0-436e-a712-10e5a3e281b5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:21.161261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e061f1a8-6db0-436e-a712-10e5a3e281b5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.364160 Feb 21 02:28:21.164805 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 89/162] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:20 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:22.182149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d4f7b80b-4736-42d5-ad09-47a10ecf7cee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:22.184501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d4f7b80b-4736-42d5-ad09-47a10ecf7cee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:22.199825 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d4f7b80b-4736-42d5-ad09-47a10ecf7cee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:22.200423 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d4f7b80b-4736-42d5-ad09-47a10ecf7cee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:22.201243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d4f7b80b-4736-42d5-ad09-47a10ecf7cee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:22.201697 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d4f7b80b-4736-42d5-ad09-47a10ecf7cee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:22.439749 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d4f7b80b-4736-42d5-ad09-47a10ecf7cee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:22.448828 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d4f7b80b-4736-42d5-ad09-47a10ecf7cee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.272663 Feb 21 02:28:22.449779 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 74/163] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:22 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:23.431238 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-797009740", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "47902730-a416-4a1e-a09f-8dbc18c262d4"}]}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:23.467106 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-be1654f3-d2fb-46d6-957b-5025b006770c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:23.467709 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-be1654f3-d2fb-46d6-957b-5025b006770c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:23.474969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-be1654f3-d2fb-46d6-957b-5025b006770c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:23.475755 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-be1654f3-d2fb-46d6-957b-5025b006770c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:23.476748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-be1654f3-d2fb-46d6-957b-5025b006770c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:23.477366 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-be1654f3-d2fb-46d6-957b-5025b006770c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:23.490663 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] validate_networks() for [('47902730-a416-4a1e-a09f-8dbc18c262d4', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:28:23.801476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-be1654f3-d2fb-46d6-957b-5025b006770c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:23.810246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-be1654f3-d2fb-46d6-957b-5025b006770c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.346644 Feb 21 02:28:23.810826 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 75/164] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:23 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:23.916353 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:28:23.916980 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:28:23.917605 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:28:23.918028 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:28:23.918453 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:28:23.927238 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:23.927830 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:23.928793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:23.929164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:23.948955 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Getting quotas for project ebe91b074cd3444ea5b8e2a29179016d. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:28:23.953400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Getting quotas for user bc9cadc548ce4093a9e1f749e5e7375c and project ebe91b074cd3444ea5b8e2a29179016d. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:28:23.966759 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:28:23.970000 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:28:24.024146 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-718710c8-cbbf-450e-b1ec-8864b89c52dd tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597075 Feb 21 02:28:24.027503 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 90/165] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:28:24.034425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f018fe02-5d1c-4701-a9b6-1b9b35c04f06 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:24.035027 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f018fe02-5d1c-4701-a9b6-1b9b35c04f06 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:24.101492 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f018fe02-5d1c-4701-a9b6-1b9b35c04f06 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:24.108275 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f018fe02-5d1c-4701-a9b6-1b9b35c04f06 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1213 microversion: 2.1 time: 0.077435 Feb 21 02:28:24.109474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 76/166] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:24 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:24.829653 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-434d645d-a20b-421e-a7ff-495fd7fb8d23 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:24.830442 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-434d645d-a20b-421e-a7ff-495fd7fb8d23 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:24.839698 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-434d645d-a20b-421e-a7ff-495fd7fb8d23 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:24.840343 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-434d645d-a20b-421e-a7ff-495fd7fb8d23 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:24.841450 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-434d645d-a20b-421e-a7ff-495fd7fb8d23 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:24.842004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-434d645d-a20b-421e-a7ff-495fd7fb8d23 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:25.013243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-434d645d-a20b-421e-a7ff-495fd7fb8d23 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:25.023485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-434d645d-a20b-421e-a7ff-495fd7fb8d23 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.198851 Feb 21 02:28:25.024124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 91/167] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:24 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:25.125768 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a6647d7e-562b-4ae0-aa11-82e40acbee77 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:25.126376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a6647d7e-562b-4ae0-aa11-82e40acbee77 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:25.132869 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a6647d7e-562b-4ae0-aa11-82e40acbee77 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:25.133197 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a6647d7e-562b-4ae0-aa11-82e40acbee77 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:25.137935 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a6647d7e-562b-4ae0-aa11-82e40acbee77 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:25.137935 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a6647d7e-562b-4ae0-aa11-82e40acbee77 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:25.197165 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a6647d7e-562b-4ae0-aa11-82e40acbee77 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:25.205058 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a6647d7e-562b-4ae0-aa11-82e40acbee77 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1265 microversion: 2.1 time: 0.083457 Feb 21 02:28:25.206106 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 77/168] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:25 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:26.040811 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-24a4827e-9637-4304-ac78-ecb7bbfa5d7a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:26.042217 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-24a4827e-9637-4304-ac78-ecb7bbfa5d7a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:26.050650 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-24a4827e-9637-4304-ac78-ecb7bbfa5d7a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:26.051287 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-24a4827e-9637-4304-ac78-ecb7bbfa5d7a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:26.054065 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-24a4827e-9637-4304-ac78-ecb7bbfa5d7a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:26.054695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-24a4827e-9637-4304-ac78-ecb7bbfa5d7a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:26.208888 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-24a4827e-9637-4304-ac78-ecb7bbfa5d7a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:26.216527 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-24a4827e-9637-4304-ac78-ecb7bbfa5d7a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.179821 Feb 21 02:28:26.217274 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 92/169] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:26 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:26.225067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5bd71185-f14a-4a90-bbfa-e4cea096c6ed tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:26.226434 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5bd71185-f14a-4a90-bbfa-e4cea096c6ed tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:26.233108 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5bd71185-f14a-4a90-bbfa-e4cea096c6ed tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:26.234003 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5bd71185-f14a-4a90-bbfa-e4cea096c6ed tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:26.236370 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5bd71185-f14a-4a90-bbfa-e4cea096c6ed tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:26.237108 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5bd71185-f14a-4a90-bbfa-e4cea096c6ed tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:26.478998 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5bd71185-f14a-4a90-bbfa-e4cea096c6ed tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:26.486990 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5bd71185-f14a-4a90-bbfa-e4cea096c6ed tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.266666 Feb 21 02:28:26.497432 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 78/170] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:26 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:26.547270 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-292ea9cf-e575-43cb-9052-f6715ab62079 req-c5c5b8fd-478a-4abd-b94b-d35feb22737a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f795772e-0d14-4397-8f5f-62af0cb15233", "tag": "0918eaa1-3a14-404c-9caf-d4c22252c6fe"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:26.548851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:28:26.548851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:28:26.556015 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-292ea9cf-e575-43cb-9052-f6715ab62079 req-c5c5b8fd-478a-4abd-b94b-d35feb22737a service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:26.556458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-292ea9cf-e575-43cb-9052-f6715ab62079 req-c5c5b8fd-478a-4abd-b94b-d35feb22737a service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:26.568251 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-292ea9cf-e575-43cb-9052-f6715ab62079 req-c5c5b8fd-478a-4abd-b94b-d35feb22737a service nova] Creating event network-changed:0918eaa1-3a14-404c-9caf-d4c22252c6fe for instance f795772e-0d14-4397-8f5f-62af0cb15233 on hv-cinder-80447 Feb 21 02:28:26.573375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-292ea9cf-e575-43cb-9052-f6715ab62079 req-c5c5b8fd-478a-4abd-b94b-d35feb22737a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029724 Feb 21 02:28:26.573998 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 93/171] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:27.233418 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0f1bfa6a-7e71-4a3b-8580-5b057b7a5672 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:27.234064 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0f1bfa6a-7e71-4a3b-8580-5b057b7a5672 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:27.240305 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0f1bfa6a-7e71-4a3b-8580-5b057b7a5672 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:27.240751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0f1bfa6a-7e71-4a3b-8580-5b057b7a5672 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:27.241530 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0f1bfa6a-7e71-4a3b-8580-5b057b7a5672 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:27.241988 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0f1bfa6a-7e71-4a3b-8580-5b057b7a5672 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:27.376798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0f1bfa6a-7e71-4a3b-8580-5b057b7a5672 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:27.384678 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0f1bfa6a-7e71-4a3b-8580-5b057b7a5672 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.154577 Feb 21 02:28:27.385061 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 79/172] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:27 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:27.504587 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7ef0d0ff-9e4e-416a-8e2b-c17111ee8bb6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:27.506729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7ef0d0ff-9e4e-416a-8e2b-c17111ee8bb6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:27.514086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7ef0d0ff-9e4e-416a-8e2b-c17111ee8bb6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:27.514480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7ef0d0ff-9e4e-416a-8e2b-c17111ee8bb6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:27.515239 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7ef0d0ff-9e4e-416a-8e2b-c17111ee8bb6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:27.515880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7ef0d0ff-9e4e-416a-8e2b-c17111ee8bb6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:27.645575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7ef0d0ff-9e4e-416a-8e2b-c17111ee8bb6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:27.653455 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7ef0d0ff-9e4e-416a-8e2b-c17111ee8bb6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.152888 Feb 21 02:28:27.654046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 94/173] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:27 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:28.401902 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2698d424-55c7-4a20-9e95-7b4e4a535ac7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:28.402505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2698d424-55c7-4a20-9e95-7b4e4a535ac7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:28.408733 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2698d424-55c7-4a20-9e95-7b4e4a535ac7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:28.409179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2698d424-55c7-4a20-9e95-7b4e4a535ac7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:28.409970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2698d424-55c7-4a20-9e95-7b4e4a535ac7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:28.410400 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2698d424-55c7-4a20-9e95-7b4e4a535ac7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:28.543622 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2698d424-55c7-4a20-9e95-7b4e4a535ac7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:28.550961 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2698d424-55c7-4a20-9e95-7b4e4a535ac7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.152650 Feb 21 02:28:28.551717 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 80/174] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:28 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:28.670099 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-619868b3-22ac-4306-8360-3296900c6ebb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:28.670768 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-619868b3-22ac-4306-8360-3296900c6ebb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:28.676961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-619868b3-22ac-4306-8360-3296900c6ebb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:28.677414 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-619868b3-22ac-4306-8360-3296900c6ebb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:28.678359 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-619868b3-22ac-4306-8360-3296900c6ebb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:28.678797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-619868b3-22ac-4306-8360-3296900c6ebb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:28.815824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-619868b3-22ac-4306-8360-3296900c6ebb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:28.823106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-619868b3-22ac-4306-8360-3296900c6ebb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.156595 Feb 21 02:28:28.823666 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 95/175] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:28 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:29.568684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7eaeb486-9853-4221-8f93-fe4d8fdc1fe2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:29.569272 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7eaeb486-9853-4221-8f93-fe4d8fdc1fe2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:29.575740 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7eaeb486-9853-4221-8f93-fe4d8fdc1fe2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:29.576179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7eaeb486-9853-4221-8f93-fe4d8fdc1fe2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:29.576946 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7eaeb486-9853-4221-8f93-fe4d8fdc1fe2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:29.577404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7eaeb486-9853-4221-8f93-fe4d8fdc1fe2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:29.718685 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7eaeb486-9853-4221-8f93-fe4d8fdc1fe2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:29.725936 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7eaeb486-9853-4221-8f93-fe4d8fdc1fe2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.161517 Feb 21 02:28:29.726488 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 81/176] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:29 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:29.840325 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fa266f1d-da7a-4ac8-beec-6d3680a4dec7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:29.840946 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fa266f1d-da7a-4ac8-beec-6d3680a4dec7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:29.852479 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa266f1d-da7a-4ac8-beec-6d3680a4dec7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:29.853003 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa266f1d-da7a-4ac8-beec-6d3680a4dec7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:29.853902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa266f1d-da7a-4ac8-beec-6d3680a4dec7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:29.854339 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa266f1d-da7a-4ac8-beec-6d3680a4dec7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:29.991523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fa266f1d-da7a-4ac8-beec-6d3680a4dec7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:29.999215 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fa266f1d-da7a-4ac8-beec-6d3680a4dec7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.162817 Feb 21 02:28:30.000030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 96/177] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:29 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:30.407297 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-cccde80b-72e9-4e1b-9c62-b004362fc434 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:30.407987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cccde80b-72e9-4e1b-9c62-b004362fc434 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:30.414485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cccde80b-72e9-4e1b-9c62-b004362fc434 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:30.415394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cccde80b-72e9-4e1b-9c62-b004362fc434 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:30.416213 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cccde80b-72e9-4e1b-9c62-b004362fc434 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:30.416631 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cccde80b-72e9-4e1b-9c62-b004362fc434 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:30.451872 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cccde80b-72e9-4e1b-9c62-b004362fc434 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:28:30.563897 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-cccde80b-72e9-4e1b-9c62-b004362fc434 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "DELETE /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 204 len: 0 microversion: 2.1 time: 0.159720 Feb 21 02:28:30.564830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 82/178] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:28:30 2022] DELETE /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:28:30.575231 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-70900673-19d1-4440-82a2-9928c62161f2 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:30.575992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-70900673-19d1-4440-82a2-9928c62161f2 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:30.583229 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-70900673-19d1-4440-82a2-9928c62161f2 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:30.585102 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-70900673-19d1-4440-82a2-9928c62161f2 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:30.586094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-70900673-19d1-4440-82a2-9928c62161f2 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:30.586604 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-70900673-19d1-4440-82a2-9928c62161f2 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:30.750882 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-10fe4a1d-0bc2-4a42-b213-8a3521959949 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:30.751636 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-10fe4a1d-0bc2-4a42-b213-8a3521959949 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:30.760048 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-10fe4a1d-0bc2-4a42-b213-8a3521959949 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:30.760496 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-10fe4a1d-0bc2-4a42-b213-8a3521959949 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:30.762235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-10fe4a1d-0bc2-4a42-b213-8a3521959949 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:30.762839 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-10fe4a1d-0bc2-4a42-b213-8a3521959949 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:30.773118 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-70900673-19d1-4440-82a2-9928c62161f2 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:30.789057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-70900673-19d1-4440-82a2-9928c62161f2 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1553 microversion: 2.1 time: 0.219291 Feb 21 02:28:30.790044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 97/179] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:30 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:30.988083 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-10fe4a1d-0bc2-4a42-b213-8a3521959949 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:30.995991 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-10fe4a1d-0bc2-4a42-b213-8a3521959949 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.250690 Feb 21 02:28:30.996780 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 83/180] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:30 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:31.016374 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-71028e83-c69a-48b4-aaf5-12df3a76d591 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:31.017040 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-71028e83-c69a-48b4-aaf5-12df3a76d591 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:31.024853 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-71028e83-c69a-48b4-aaf5-12df3a76d591 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:31.025440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-71028e83-c69a-48b4-aaf5-12df3a76d591 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:31.028908 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-71028e83-c69a-48b4-aaf5-12df3a76d591 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:31.028908 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-71028e83-c69a-48b4-aaf5-12df3a76d591 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:31.168129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-71028e83-c69a-48b4-aaf5-12df3a76d591 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:31.176595 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-71028e83-c69a-48b4-aaf5-12df3a76d591 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.164427 Feb 21 02:28:31.179022 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 98/181] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:31 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:31.806348 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7736f317-db2e-4631-9e78-cd0fbb7247f5 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:31.807037 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7736f317-db2e-4631-9e78-cd0fbb7247f5 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:31.813005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7736f317-db2e-4631-9e78-cd0fbb7247f5 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:31.813521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7736f317-db2e-4631-9e78-cd0fbb7247f5 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:31.814325 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7736f317-db2e-4631-9e78-cd0fbb7247f5 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:31.814757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7736f317-db2e-4631-9e78-cd0fbb7247f5 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:31.957734 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7736f317-db2e-4631-9e78-cd0fbb7247f5 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:31.967243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7736f317-db2e-4631-9e78-cd0fbb7247f5 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1553 microversion: 2.1 time: 0.164648 Feb 21 02:28:31.974898 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 84/182] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:31 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:32.013594 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-94be0755-2d2d-423a-9e58-9e90bb54f733 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:32.014223 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-94be0755-2d2d-423a-9e58-9e90bb54f733 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:32.032193 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-94be0755-2d2d-423a-9e58-9e90bb54f733 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:32.032193 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-94be0755-2d2d-423a-9e58-9e90bb54f733 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:32.032193 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-94be0755-2d2d-423a-9e58-9e90bb54f733 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:32.032193 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-94be0755-2d2d-423a-9e58-9e90bb54f733 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:32.193989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-94be0755-2d2d-423a-9e58-9e90bb54f733 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:32.198170 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-265b6b52-5e6a-4e1b-bf46-ff75a8d10aaa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:32.198990 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-265b6b52-5e6a-4e1b-bf46-ff75a8d10aaa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:32.202723 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-94be0755-2d2d-423a-9e58-9e90bb54f733 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.192694 Feb 21 02:28:32.204013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 99/183] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:32 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:32.206426 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-265b6b52-5e6a-4e1b-bf46-ff75a8d10aaa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:32.207148 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-265b6b52-5e6a-4e1b-bf46-ff75a8d10aaa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:32.208092 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-265b6b52-5e6a-4e1b-bf46-ff75a8d10aaa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:32.209292 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-265b6b52-5e6a-4e1b-bf46-ff75a8d10aaa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:32.389281 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-265b6b52-5e6a-4e1b-bf46-ff75a8d10aaa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:32.396965 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-265b6b52-5e6a-4e1b-bf46-ff75a8d10aaa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.205181 Feb 21 02:28:32.397547 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 85/184] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:32 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:32.992685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a5cfb1a3-0178-4859-9af7-794b3548a268 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:32.993430 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a5cfb1a3-0178-4859-9af7-794b3548a268 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:32.999454 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a5cfb1a3-0178-4859-9af7-794b3548a268 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:33.000022 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a5cfb1a3-0178-4859-9af7-794b3548a268 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:33.000866 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a5cfb1a3-0178-4859-9af7-794b3548a268 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:33.001365 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a5cfb1a3-0178-4859-9af7-794b3548a268 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:33.151393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a5cfb1a3-0178-4859-9af7-794b3548a268 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:33.159539 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a5cfb1a3-0178-4859-9af7-794b3548a268 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1553 microversion: 2.1 time: 0.171827 Feb 21 02:28:33.160200 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 100/185] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:32 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:33.222773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-46b55923-58f5-40bd-88dd-a3a4ee418304 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:33.223655 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-46b55923-58f5-40bd-88dd-a3a4ee418304 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:33.231087 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-46b55923-58f5-40bd-88dd-a3a4ee418304 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:33.231612 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-46b55923-58f5-40bd-88dd-a3a4ee418304 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:33.232472 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-46b55923-58f5-40bd-88dd-a3a4ee418304 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:33.232977 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-46b55923-58f5-40bd-88dd-a3a4ee418304 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:33.395274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-46b55923-58f5-40bd-88dd-a3a4ee418304 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:33.408238 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-46b55923-58f5-40bd-88dd-a3a4ee418304 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.189297 Feb 21 02:28:33.409452 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 86/186] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:33 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:33.422507 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5d159f16-1cf5-4d5f-805b-c6222503eccb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:33.423363 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5d159f16-1cf5-4d5f-805b-c6222503eccb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:33.431110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5d159f16-1cf5-4d5f-805b-c6222503eccb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:33.431771 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5d159f16-1cf5-4d5f-805b-c6222503eccb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:33.432744 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5d159f16-1cf5-4d5f-805b-c6222503eccb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:33.433334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5d159f16-1cf5-4d5f-805b-c6222503eccb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:33.603718 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5d159f16-1cf5-4d5f-805b-c6222503eccb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:33.614220 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5d159f16-1cf5-4d5f-805b-c6222503eccb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.195190 Feb 21 02:28:33.615015 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 101/187] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:33 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:34.178120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9f35f0c6-bf3c-4d77-a4df-6313d70d88b4 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:34.178638 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9f35f0c6-bf3c-4d77-a4df-6313d70d88b4 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:34.189568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9f35f0c6-bf3c-4d77-a4df-6313d70d88b4 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:34.190586 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9f35f0c6-bf3c-4d77-a4df-6313d70d88b4 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:34.194629 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9f35f0c6-bf3c-4d77-a4df-6313d70d88b4 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:34.195273 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9f35f0c6-bf3c-4d77-a4df-6313d70d88b4 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:34.287747 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-67c1457e-04cb-4cef-91b3-c043b4a4fae4 req-e2ccd36a-343d-49dd-8d46-5198d45b4b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57db8fe7-822f-4654-af4d-f883ba203764", "name": "network-vif-deleted", "tag": "564ee339-f6a7-4482-9e82-3e4945304a7c"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:34.297323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:28:34.297323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:28:34.327881 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-67c1457e-04cb-4cef-91b3-c043b4a4fae4 req-e2ccd36a-343d-49dd-8d46-5198d45b4b34 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:34.331846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-67c1457e-04cb-4cef-91b3-c043b4a4fae4 req-e2ccd36a-343d-49dd-8d46-5198d45b4b34 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:34.333887 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9f35f0c6-bf3c-4d77-a4df-6313d70d88b4 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:34.343698 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9f35f0c6-bf3c-4d77-a4df-6313d70d88b4 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1511 microversion: 2.1 time: 0.169804 Feb 21 02:28:34.347498 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 87/188] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:34 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:34.366777 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-67c1457e-04cb-4cef-91b3-c043b4a4fae4 req-e2ccd36a-343d-49dd-8d46-5198d45b4b34 service nova] Creating event network-vif-deleted:564ee339-f6a7-4482-9e82-3e4945304a7c for instance 57db8fe7-822f-4654-af4d-f883ba203764 on hv-cinder-80447 Feb 21 02:28:34.373674 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-67c1457e-04cb-4cef-91b3-c043b4a4fae4 req-e2ccd36a-343d-49dd-8d46-5198d45b4b34 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090705 Feb 21 02:28:34.378870 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 102/189] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:34.425818 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1fbbec0b-edaa-4d20-a53c-b02b5470d24a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:34.426692 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1fbbec0b-edaa-4d20-a53c-b02b5470d24a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:34.435717 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1fbbec0b-edaa-4d20-a53c-b02b5470d24a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:34.436447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1fbbec0b-edaa-4d20-a53c-b02b5470d24a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:34.437396 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1fbbec0b-edaa-4d20-a53c-b02b5470d24a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:34.438526 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1fbbec0b-edaa-4d20-a53c-b02b5470d24a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:34.607108 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1fbbec0b-edaa-4d20-a53c-b02b5470d24a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:34.616588 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1fbbec0b-edaa-4d20-a53c-b02b5470d24a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.194937 Feb 21 02:28:34.618172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 88/190] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:34 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:34.632154 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6d323209-a88d-4a94-be7c-fc44dc232550 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:34.632911 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6d323209-a88d-4a94-be7c-fc44dc232550 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:34.639095 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d323209-a88d-4a94-be7c-fc44dc232550 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:34.639538 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d323209-a88d-4a94-be7c-fc44dc232550 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:34.640618 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d323209-a88d-4a94-be7c-fc44dc232550 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:34.652733 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d323209-a88d-4a94-be7c-fc44dc232550 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:34.833853 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6d323209-a88d-4a94-be7c-fc44dc232550 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:34.843668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6d323209-a88d-4a94-be7c-fc44dc232550 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.216081 Feb 21 02:28:34.844649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 103/191] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:34 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:35.368610 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:35.369841 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:35.384011 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:35.384461 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:35.385258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:35.385911 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:35.431985 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:35.432430 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:35.432889 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lazy-loading 'fault' on Instance uuid 57db8fe7-822f-4654-af4d-f883ba203764 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:28:35.499071 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1925a549279483e9228a5d947bfdd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d76be89b774996b1207493325848df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:35.506016 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c757b167-97ad-42d5-b5d1-81c2fc77dd98 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 200 len: 1304 microversion: 2.1 time: 0.141483 Feb 21 02:28:35.507192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 89/192] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:35 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:35.635901 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1129d42d-b1e7-4aaf-a782-3e942f7c97ff tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:35.636804 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1129d42d-b1e7-4aaf-a782-3e942f7c97ff tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:35.644560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1129d42d-b1e7-4aaf-a782-3e942f7c97ff tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:35.645112 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1129d42d-b1e7-4aaf-a782-3e942f7c97ff tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:35.646764 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1129d42d-b1e7-4aaf-a782-3e942f7c97ff tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:35.647292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1129d42d-b1e7-4aaf-a782-3e942f7c97ff tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:35.813498 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1129d42d-b1e7-4aaf-a782-3e942f7c97ff tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:35.830036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1129d42d-b1e7-4aaf-a782-3e942f7c97ff tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.198586 Feb 21 02:28:35.830618 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 104/193] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:35 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:35.862169 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d9cb7642-d4a9-4789-9f02-743e6fdee909 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:35.863423 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d9cb7642-d4a9-4789-9f02-743e6fdee909 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:35.873460 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d9cb7642-d4a9-4789-9f02-743e6fdee909 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:35.874492 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d9cb7642-d4a9-4789-9f02-743e6fdee909 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:35.875453 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d9cb7642-d4a9-4789-9f02-743e6fdee909 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:35.876231 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d9cb7642-d4a9-4789-9f02-743e6fdee909 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:36.152571 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d9cb7642-d4a9-4789-9f02-743e6fdee909 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:36.159875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d9cb7642-d4a9-4789-9f02-743e6fdee909 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.303572 Feb 21 02:28:36.160576 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 90/194] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:35 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:36.524543 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:36.525051 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:36.530968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:36.531695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:36.532464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:36.532889 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:36.545512 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] HTTP exception thrown: Instance 57db8fe7-822f-4654-af4d-f883ba203764 could not be found. Feb 21 02:28:36.546294 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Returning 404 to user: Instance 57db8fe7-822f-4654-af4d-f883ba203764 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:36.547091 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3ce4a934-1908-4f1b-b42c-a000f381cb3f tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 404 len: 111 microversion: 2.1 time: 0.027480 Feb 21 02:28:36.547619 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 105/195] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:36 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:28:36.647762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:36.648753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:36.654976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:36.655427 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:36.656202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:36.656638 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:36.669349 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] HTTP exception thrown: Instance 57db8fe7-822f-4654-af4d-f883ba203764 could not be found. Feb 21 02:28:36.669963 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Returning 404 to user: Instance 57db8fe7-822f-4654-af4d-f883ba203764 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:36.670775 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c3d1507a-c86d-48bd-8b43-1688aa5b2f5d tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027617 Feb 21 02:28:36.671298 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 91/196] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:28:36 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:28:36.846227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c5ffb91c-91da-461c-b403-ec62566e7839 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:36.846826 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c5ffb91c-91da-461c-b403-ec62566e7839 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:36.853417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c5ffb91c-91da-461c-b403-ec62566e7839 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:36.853895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c5ffb91c-91da-461c-b403-ec62566e7839 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:36.854656 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c5ffb91c-91da-461c-b403-ec62566e7839 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:36.855082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c5ffb91c-91da-461c-b403-ec62566e7839 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:37.001098 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c5ffb91c-91da-461c-b403-ec62566e7839 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:37.009214 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c5ffb91c-91da-461c-b403-ec62566e7839 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.166459 Feb 21 02:28:37.010003 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 106/197] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:36 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:37.177685 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a2f7f8d3-eba2-47fb-bcda-bec5dd5aa4da tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:37.178350 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a2f7f8d3-eba2-47fb-bcda-bec5dd5aa4da tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:37.184135 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2f7f8d3-eba2-47fb-bcda-bec5dd5aa4da tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:37.184582 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2f7f8d3-eba2-47fb-bcda-bec5dd5aa4da tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:37.185359 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2f7f8d3-eba2-47fb-bcda-bec5dd5aa4da tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:37.185830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2f7f8d3-eba2-47fb-bcda-bec5dd5aa4da tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:37.328335 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a2f7f8d3-eba2-47fb-bcda-bec5dd5aa4da tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:37.336382 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a2f7f8d3-eba2-47fb-bcda-bec5dd5aa4da tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.162836 Feb 21 02:28:37.336953 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 92/198] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:37 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:37.524347 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-487933385", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "d4d7fbe4-b74f-4889-adca-b065ca5bd2cf"}]}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:37.573796 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] validate_networks() for [('d4d7fbe4-b74f-4889-adca-b065ca5bd2cf', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:28:37.930269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:28:37.930848 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:28:37.931136 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:28:37.931572 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:28:37.931973 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:28:37.940966 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:37.941409 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:37.942248 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:37.942710 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:37.959050 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Getting quotas for project 440cb05903bb427baa54dbe25b56ee7c. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:28:37.962862 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Getting quotas for user 533f0f53f5504f0caec419a41f0f7452 and project 440cb05903bb427baa54dbe25b56ee7c. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:28:37.973079 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:28:37.976104 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:28:38.019924 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3df65781-47f4-4e66-a19c-91fa451de01c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499189 Feb 21 02:28:38.020565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 107/199] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:28:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:28:38.029975 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6d457c1d-25b8-4aae-8b57-ecb9143e9bf2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:38.030776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6d457c1d-25b8-4aae-8b57-ecb9143e9bf2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:38.031098 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f048ab08-9a21-44e7-8578-2fd4ca1a7d2a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:38.031713 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f048ab08-9a21-44e7-8578-2fd4ca1a7d2a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:38.037804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6d457c1d-25b8-4aae-8b57-ecb9143e9bf2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:38.038454 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6d457c1d-25b8-4aae-8b57-ecb9143e9bf2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:38.039247 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6d457c1d-25b8-4aae-8b57-ecb9143e9bf2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:38.039678 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6d457c1d-25b8-4aae-8b57-ecb9143e9bf2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:38.085008 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f048ab08-9a21-44e7-8578-2fd4ca1a7d2a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:38.092008 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f048ab08-9a21-44e7-8578-2fd4ca1a7d2a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1217 microversion: 2.1 time: 0.064398 Feb 21 02:28:38.092713 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 108/200] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:38 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:38.206455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6d457c1d-25b8-4aae-8b57-ecb9143e9bf2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:38.207444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6d457c1d-25b8-4aae-8b57-ecb9143e9bf2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.180941 Feb 21 02:28:38.216990 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 93/201] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:38 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:38.353703 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e6f53746-e7e4-42e2-a952-6665e3e37e48 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:38.354306 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e6f53746-e7e4-42e2-a952-6665e3e37e48 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:38.361437 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e6f53746-e7e4-42e2-a952-6665e3e37e48 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:38.361905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e6f53746-e7e4-42e2-a952-6665e3e37e48 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:38.369201 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e6f53746-e7e4-42e2-a952-6665e3e37e48 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:38.369670 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e6f53746-e7e4-42e2-a952-6665e3e37e48 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:38.370937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-eed4312b-2125-4ad4-8ae7-97b9cd72bf3f req-8aafd9b7-9646-4ac7-bf29-14448af72061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f795772e-0d14-4397-8f5f-62af0cb15233", "name": "network-vif-plugged", "status": "completed", "tag": "0918eaa1-3a14-404c-9caf-d4c22252c6fe"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:38.372580 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:28:38.372580 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:28:38.382684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-eed4312b-2125-4ad4-8ae7-97b9cd72bf3f req-8aafd9b7-9646-4ac7-bf29-14448af72061 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:38.383183 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-eed4312b-2125-4ad4-8ae7-97b9cd72bf3f req-8aafd9b7-9646-4ac7-bf29-14448af72061 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:38.397970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-eed4312b-2125-4ad4-8ae7-97b9cd72bf3f req-8aafd9b7-9646-4ac7-bf29-14448af72061 service nova] Creating event network-vif-plugged:0918eaa1-3a14-404c-9caf-d4c22252c6fe for instance f795772e-0d14-4397-8f5f-62af0cb15233 on hv-cinder-80447 Feb 21 02:28:38.405785 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-eed4312b-2125-4ad4-8ae7-97b9cd72bf3f req-8aafd9b7-9646-4ac7-bf29-14448af72061 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038599 Feb 21 02:28:38.406903 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 94/202] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:38.522296 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e6f53746-e7e4-42e2-a952-6665e3e37e48 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:38.529538 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e6f53746-e7e4-42e2-a952-6665e3e37e48 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.179605 Feb 21 02:28:38.530207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 109/203] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:38 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:39.108961 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b067dbd2-8b0b-40b3-b221-f5e6db69ee71 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:39.109861 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b067dbd2-8b0b-40b3-b221-f5e6db69ee71 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:39.117029 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b067dbd2-8b0b-40b3-b221-f5e6db69ee71 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:39.117467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b067dbd2-8b0b-40b3-b221-f5e6db69ee71 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:39.118294 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b067dbd2-8b0b-40b3-b221-f5e6db69ee71 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:39.118726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b067dbd2-8b0b-40b3-b221-f5e6db69ee71 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:39.179107 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b067dbd2-8b0b-40b3-b221-f5e6db69ee71 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:39.186201 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b067dbd2-8b0b-40b3-b221-f5e6db69ee71 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1221 microversion: 2.1 time: 0.081261 Feb 21 02:28:39.186768 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 95/204] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:39 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:39.224757 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c34bdd3f-c281-484f-bd83-072f9ebdcefd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:39.225387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c34bdd3f-c281-484f-bd83-072f9ebdcefd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:39.231524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c34bdd3f-c281-484f-bd83-072f9ebdcefd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:39.231965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c34bdd3f-c281-484f-bd83-072f9ebdcefd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:39.232724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c34bdd3f-c281-484f-bd83-072f9ebdcefd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:39.233150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c34bdd3f-c281-484f-bd83-072f9ebdcefd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:39.368951 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c34bdd3f-c281-484f-bd83-072f9ebdcefd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:39.376949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c34bdd3f-c281-484f-bd83-072f9ebdcefd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.156518 Feb 21 02:28:39.377518 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 110/205] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:39 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:39.546802 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-968e78ff-fcb2-4448-aca9-b65733d78481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:39.547517 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-968e78ff-fcb2-4448-aca9-b65733d78481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:39.553944 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-968e78ff-fcb2-4448-aca9-b65733d78481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:39.554387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-968e78ff-fcb2-4448-aca9-b65733d78481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:39.555150 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-968e78ff-fcb2-4448-aca9-b65733d78481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:39.555577 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-968e78ff-fcb2-4448-aca9-b65733d78481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:39.688056 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-968e78ff-fcb2-4448-aca9-b65733d78481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:39.695884 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-968e78ff-fcb2-4448-aca9-b65733d78481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.152725 Feb 21 02:28:39.696437 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 96/206] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:39 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:40.202145 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ccbfa05e-74dd-4a74-bddd-37b17cbfd4a4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:40.202656 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ccbfa05e-74dd-4a74-bddd-37b17cbfd4a4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:40.208683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ccbfa05e-74dd-4a74-bddd-37b17cbfd4a4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:40.209227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ccbfa05e-74dd-4a74-bddd-37b17cbfd4a4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:40.210020 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ccbfa05e-74dd-4a74-bddd-37b17cbfd4a4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:40.210445 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ccbfa05e-74dd-4a74-bddd-37b17cbfd4a4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:40.267851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ccbfa05e-74dd-4a74-bddd-37b17cbfd4a4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:40.275094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ccbfa05e-74dd-4a74-bddd-37b17cbfd4a4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1221 microversion: 2.1 time: 0.076640 Feb 21 02:28:40.275644 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 111/207] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:40 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:40.394118 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-329c712d-7465-4fbd-9031-4e828b497be9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:40.394726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-329c712d-7465-4fbd-9031-4e828b497be9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:40.400923 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-329c712d-7465-4fbd-9031-4e828b497be9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:40.401400 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-329c712d-7465-4fbd-9031-4e828b497be9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:40.402210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-329c712d-7465-4fbd-9031-4e828b497be9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:40.402644 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-329c712d-7465-4fbd-9031-4e828b497be9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:40.539384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-329c712d-7465-4fbd-9031-4e828b497be9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:40.546763 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-329c712d-7465-4fbd-9031-4e828b497be9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.156263 Feb 21 02:28:40.547339 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 97/208] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:40 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:40.713819 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a914925a-edbc-4b74-97f5-9c641c50450d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:40.714421 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a914925a-edbc-4b74-97f5-9c641c50450d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:40.720183 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a914925a-edbc-4b74-97f5-9c641c50450d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:40.720619 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a914925a-edbc-4b74-97f5-9c641c50450d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:40.721376 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a914925a-edbc-4b74-97f5-9c641c50450d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:40.721845 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a914925a-edbc-4b74-97f5-9c641c50450d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:40.857171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a914925a-edbc-4b74-97f5-9c641c50450d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:40.865870 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a914925a-edbc-4b74-97f5-9c641c50450d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.155526 Feb 21 02:28:40.866487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 112/209] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:40 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:41.292050 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-25711750-079c-49c1-8771-696405fafc04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:41.292727 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-25711750-079c-49c1-8771-696405fafc04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:41.298623 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25711750-079c-49c1-8771-696405fafc04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:41.299063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25711750-079c-49c1-8771-696405fafc04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:41.299825 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25711750-079c-49c1-8771-696405fafc04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:41.300279 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25711750-079c-49c1-8771-696405fafc04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:41.358525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-25711750-079c-49c1-8771-696405fafc04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:41.366740 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-25711750-079c-49c1-8771-696405fafc04 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1221 microversion: 2.1 time: 0.078375 Feb 21 02:28:41.367304 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 98/210] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:41 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:41.564617 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d19dafa3-c679-44b3-9aa5-4656ec0a72e9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:41.565174 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d19dafa3-c679-44b3-9aa5-4656ec0a72e9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:41.572148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d19dafa3-c679-44b3-9aa5-4656ec0a72e9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:41.572596 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d19dafa3-c679-44b3-9aa5-4656ec0a72e9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:41.573367 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d19dafa3-c679-44b3-9aa5-4656ec0a72e9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:41.573840 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d19dafa3-c679-44b3-9aa5-4656ec0a72e9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:41.706526 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d19dafa3-c679-44b3-9aa5-4656ec0a72e9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:41.714005 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d19dafa3-c679-44b3-9aa5-4656ec0a72e9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.153058 Feb 21 02:28:41.714576 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 113/211] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:41 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:41.882236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-600c9bce-2930-4454-9da8-c236726696c0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:41.882798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-600c9bce-2930-4454-9da8-c236726696c0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:41.889180 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-600c9bce-2930-4454-9da8-c236726696c0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:41.889629 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-600c9bce-2930-4454-9da8-c236726696c0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:41.890506 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-600c9bce-2930-4454-9da8-c236726696c0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:41.890962 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-600c9bce-2930-4454-9da8-c236726696c0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:42.089258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-600c9bce-2930-4454-9da8-c236726696c0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:42.096543 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-600c9bce-2930-4454-9da8-c236726696c0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.218080 Feb 21 02:28:42.097113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 99/212] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:41 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:42.382857 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3ada4428-ff46-4d7e-adcc-0ee4980dbe8e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:42.383463 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3ada4428-ff46-4d7e-adcc-0ee4980dbe8e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:42.389263 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ada4428-ff46-4d7e-adcc-0ee4980dbe8e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:42.389736 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ada4428-ff46-4d7e-adcc-0ee4980dbe8e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:42.390510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ada4428-ff46-4d7e-adcc-0ee4980dbe8e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:42.390935 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ada4428-ff46-4d7e-adcc-0ee4980dbe8e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:42.460128 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3ada4428-ff46-4d7e-adcc-0ee4980dbe8e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:42.467513 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3ada4428-ff46-4d7e-adcc-0ee4980dbe8e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1269 microversion: 2.1 time: 0.088400 Feb 21 02:28:42.468245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 114/213] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:42 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:42.730627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ad9ea860-a98c-4cb1-8416-6510e8e3a7b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:42.731294 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ad9ea860-a98c-4cb1-8416-6510e8e3a7b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:42.737447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ad9ea860-a98c-4cb1-8416-6510e8e3a7b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:42.737930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ad9ea860-a98c-4cb1-8416-6510e8e3a7b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:42.738708 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ad9ea860-a98c-4cb1-8416-6510e8e3a7b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:42.739149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ad9ea860-a98c-4cb1-8416-6510e8e3a7b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:42.869875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ad9ea860-a98c-4cb1-8416-6510e8e3a7b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:42.877128 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ad9ea860-a98c-4cb1-8416-6510e8e3a7b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.150123 Feb 21 02:28:42.877717 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 100/214] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:42 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:43.113433 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fabae0e8-6f7f-45b9-bf3d-e387d8b77d45 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:43.114115 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fabae0e8-6f7f-45b9-bf3d-e387d8b77d45 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:43.120898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fabae0e8-6f7f-45b9-bf3d-e387d8b77d45 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:43.121344 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fabae0e8-6f7f-45b9-bf3d-e387d8b77d45 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:43.122132 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fabae0e8-6f7f-45b9-bf3d-e387d8b77d45 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:43.122561 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fabae0e8-6f7f-45b9-bf3d-e387d8b77d45 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:43.254605 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fabae0e8-6f7f-45b9-bf3d-e387d8b77d45 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:43.262091 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fabae0e8-6f7f-45b9-bf3d-e387d8b77d45 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.152415 Feb 21 02:28:43.262681 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 115/215] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:43 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:43.486477 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9b3b9c5a-0208-48e5-aa8b-7f0d97295c12 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:43.487083 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9b3b9c5a-0208-48e5-aa8b-7f0d97295c12 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:43.494091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b3b9c5a-0208-48e5-aa8b-7f0d97295c12 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:43.494538 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b3b9c5a-0208-48e5-aa8b-7f0d97295c12 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:43.495307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b3b9c5a-0208-48e5-aa8b-7f0d97295c12 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:43.495738 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b3b9c5a-0208-48e5-aa8b-7f0d97295c12 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:43.559102 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9b3b9c5a-0208-48e5-aa8b-7f0d97295c12 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:43.566960 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9b3b9c5a-0208-48e5-aa8b-7f0d97295c12 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1269 microversion: 2.1 time: 0.084428 Feb 21 02:28:43.567534 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 101/216] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:43 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:43.894138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a4041e25-1e7e-4a7b-9d83-11e8ec9167bb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:43.894733 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a4041e25-1e7e-4a7b-9d83-11e8ec9167bb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:43.900754 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4041e25-1e7e-4a7b-9d83-11e8ec9167bb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:43.901192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4041e25-1e7e-4a7b-9d83-11e8ec9167bb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:43.901981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4041e25-1e7e-4a7b-9d83-11e8ec9167bb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:43.902407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4041e25-1e7e-4a7b-9d83-11e8ec9167bb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:44.033421 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a4041e25-1e7e-4a7b-9d83-11e8ec9167bb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:44.041264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a4041e25-1e7e-4a7b-9d83-11e8ec9167bb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.150663 Feb 21 02:28:44.041865 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 116/217] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:43 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:44.278450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8d2e3a87-0944-4932-943b-9f6edb0530e8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:44.279065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8d2e3a87-0944-4932-943b-9f6edb0530e8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:44.284913 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d2e3a87-0944-4932-943b-9f6edb0530e8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:44.285300 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d2e3a87-0944-4932-943b-9f6edb0530e8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:44.286114 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d2e3a87-0944-4932-943b-9f6edb0530e8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:44.287160 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d2e3a87-0944-4932-943b-9f6edb0530e8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:44.424493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8d2e3a87-0944-4932-943b-9f6edb0530e8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:44.431682 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8d2e3a87-0944-4932-943b-9f6edb0530e8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.156895 Feb 21 02:28:44.432251 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 102/218] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:44 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:44.583954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4a633a86-2af0-48b6-8266-6aad6950bea8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:44.584560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4a633a86-2af0-48b6-8266-6aad6950bea8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:44.590662 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4a633a86-2af0-48b6-8266-6aad6950bea8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:44.591101 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4a633a86-2af0-48b6-8266-6aad6950bea8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:44.591865 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4a633a86-2af0-48b6-8266-6aad6950bea8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:44.592291 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4a633a86-2af0-48b6-8266-6aad6950bea8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:44.650716 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4a633a86-2af0-48b6-8266-6aad6950bea8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:44.657724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4a633a86-2af0-48b6-8266-6aad6950bea8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1269 microversion: 2.1 time: 0.077941 Feb 21 02:28:44.658283 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 117/219] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:44 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1269 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:45.057052 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-53a22de0-9935-4fbe-a06d-174c889bd472 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:45.057584 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-53a22de0-9935-4fbe-a06d-174c889bd472 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:45.063969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-53a22de0-9935-4fbe-a06d-174c889bd472 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:45.064425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-53a22de0-9935-4fbe-a06d-174c889bd472 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:45.065204 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-53a22de0-9935-4fbe-a06d-174c889bd472 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:45.065657 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-53a22de0-9935-4fbe-a06d-174c889bd472 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:45.196859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-53a22de0-9935-4fbe-a06d-174c889bd472 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:45.204171 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-53a22de0-9935-4fbe-a06d-174c889bd472 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.151076 Feb 21 02:28:45.204728 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 103/220] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:45 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:45.448686 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-51510e32-69ab-4c49-9e31-2e7207fe5518 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:45.449278 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-51510e32-69ab-4c49-9e31-2e7207fe5518 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:45.455292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-51510e32-69ab-4c49-9e31-2e7207fe5518 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:45.455747 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-51510e32-69ab-4c49-9e31-2e7207fe5518 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:45.456524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-51510e32-69ab-4c49-9e31-2e7207fe5518 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:45.456959 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-51510e32-69ab-4c49-9e31-2e7207fe5518 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:45.593796 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-51510e32-69ab-4c49-9e31-2e7207fe5518 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:45.601497 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-51510e32-69ab-4c49-9e31-2e7207fe5518 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.156400 Feb 21 02:28:45.602093 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 118/221] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:45 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:45.674983 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6a5023f1-9e03-4b03-b2f2-66d7effe0880 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:45.675592 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6a5023f1-9e03-4b03-b2f2-66d7effe0880 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:45.682110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6a5023f1-9e03-4b03-b2f2-66d7effe0880 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:45.682560 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6a5023f1-9e03-4b03-b2f2-66d7effe0880 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:45.683342 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6a5023f1-9e03-4b03-b2f2-66d7effe0880 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:45.683778 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6a5023f1-9e03-4b03-b2f2-66d7effe0880 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:45.745161 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6a5023f1-9e03-4b03-b2f2-66d7effe0880 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:45.752764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6a5023f1-9e03-4b03-b2f2-66d7effe0880 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1277 microversion: 2.1 time: 0.081339 Feb 21 02:28:45.753333 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 104/222] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:45 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1277 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:46.219822 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-681324f9-3d58-4271-b96b-f7477b6f7cf5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:46.220425 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-681324f9-3d58-4271-b96b-f7477b6f7cf5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:46.227469 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-681324f9-3d58-4271-b96b-f7477b6f7cf5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:46.228033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-681324f9-3d58-4271-b96b-f7477b6f7cf5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:46.228812 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-681324f9-3d58-4271-b96b-f7477b6f7cf5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:46.229244 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-681324f9-3d58-4271-b96b-f7477b6f7cf5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:46.362181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-681324f9-3d58-4271-b96b-f7477b6f7cf5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:46.369896 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-681324f9-3d58-4271-b96b-f7477b6f7cf5 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.153401 Feb 21 02:28:46.370283 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 119/223] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:46 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:46.618474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9e563bbb-cfe0-4d50-86a3-f0542e4f8f34 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:46.619088 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9e563bbb-cfe0-4d50-86a3-f0542e4f8f34 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:46.625287 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e563bbb-cfe0-4d50-86a3-f0542e4f8f34 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:46.625773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e563bbb-cfe0-4d50-86a3-f0542e4f8f34 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:46.626554 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e563bbb-cfe0-4d50-86a3-f0542e4f8f34 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:46.626995 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e563bbb-cfe0-4d50-86a3-f0542e4f8f34 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:46.761969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9e563bbb-cfe0-4d50-86a3-f0542e4f8f34 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:46.769285 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9e563bbb-cfe0-4d50-86a3-f0542e4f8f34 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.155294 Feb 21 02:28:46.769429 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b43c095d-4337-4144-94ec-6b481ec48f09 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:46.769879 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 105/224] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:46 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:46.769971 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b43c095d-4337-4144-94ec-6b481ec48f09 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:46.776602 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b43c095d-4337-4144-94ec-6b481ec48f09 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:46.777046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b43c095d-4337-4144-94ec-6b481ec48f09 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:46.777857 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b43c095d-4337-4144-94ec-6b481ec48f09 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:46.778309 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b43c095d-4337-4144-94ec-6b481ec48f09 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:46.838405 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b43c095d-4337-4144-94ec-6b481ec48f09 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:46.845496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b43c095d-4337-4144-94ec-6b481ec48f09 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1277 microversion: 2.1 time: 0.079731 Feb 21 02:28:46.846038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 120/225] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:46 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:47.385603 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bbe5bdce-5e2a-42ec-b844-fb92c9086a79 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:47.386334 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bbe5bdce-5e2a-42ec-b844-fb92c9086a79 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:47.392246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bbe5bdce-5e2a-42ec-b844-fb92c9086a79 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:47.392694 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bbe5bdce-5e2a-42ec-b844-fb92c9086a79 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:47.393478 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bbe5bdce-5e2a-42ec-b844-fb92c9086a79 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:47.393927 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bbe5bdce-5e2a-42ec-b844-fb92c9086a79 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:47.786515 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f672a3fa-f4a9-46c9-a720-cb3fa5bcddc6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:47.787119 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f672a3fa-f4a9-46c9-a720-cb3fa5bcddc6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:47.792834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f672a3fa-f4a9-46c9-a720-cb3fa5bcddc6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:47.793275 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f672a3fa-f4a9-46c9-a720-cb3fa5bcddc6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:47.794088 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f672a3fa-f4a9-46c9-a720-cb3fa5bcddc6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:47.794499 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f672a3fa-f4a9-46c9-a720-cb3fa5bcddc6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:47.801540 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bbe5bdce-5e2a-42ec-b844-fb92c9086a79 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:47.809096 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bbe5bdce-5e2a-42ec-b844-fb92c9086a79 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.427175 Feb 21 02:28:47.809887 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 106/226] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:47 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:47.862832 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0fcd4562-6cd4-4054-80c9-19da52240e67 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:47.863458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0fcd4562-6cd4-4054-80c9-19da52240e67 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:47.871143 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0fcd4562-6cd4-4054-80c9-19da52240e67 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:47.872163 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0fcd4562-6cd4-4054-80c9-19da52240e67 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:47.872968 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0fcd4562-6cd4-4054-80c9-19da52240e67 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:47.873413 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0fcd4562-6cd4-4054-80c9-19da52240e67 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:47.942771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0fcd4562-6cd4-4054-80c9-19da52240e67 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:47.944403 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f672a3fa-f4a9-46c9-a720-cb3fa5bcddc6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:47.951974 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f672a3fa-f4a9-46c9-a720-cb3fa5bcddc6 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.169235 Feb 21 02:28:47.952333 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0fcd4562-6cd4-4054-80c9-19da52240e67 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1275 microversion: 2.1 time: 0.093773 Feb 21 02:28:47.953366 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 107/227] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:47 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:47.958967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 121/228] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:47 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:48.826626 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b0e2b75d-6049-4e7e-8787-aab0663d6e70 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:48.827255 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b0e2b75d-6049-4e7e-8787-aab0663d6e70 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:48.833887 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0e2b75d-6049-4e7e-8787-aab0663d6e70 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:48.834536 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0e2b75d-6049-4e7e-8787-aab0663d6e70 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:48.835507 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0e2b75d-6049-4e7e-8787-aab0663d6e70 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:48.835951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0e2b75d-6049-4e7e-8787-aab0663d6e70 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:48.928113 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-9d1a7215-d66b-477a-8d79-e435c5abe414 req-fa125d25-745f-40f0-b5d4-8bf6e892d441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb", "tag": "b84a1600-9302-43ac-8004-61bd10577802"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:48.932476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:28:48.932476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:28:48.950655 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-9d1a7215-d66b-477a-8d79-e435c5abe414 req-fa125d25-745f-40f0-b5d4-8bf6e892d441 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:48.951950 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-9d1a7215-d66b-477a-8d79-e435c5abe414 req-fa125d25-745f-40f0-b5d4-8bf6e892d441 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:48.967933 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-9d1a7215-d66b-477a-8d79-e435c5abe414 req-fa125d25-745f-40f0-b5d4-8bf6e892d441 service nova] Creating event network-changed:b84a1600-9302-43ac-8004-61bd10577802 for instance c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb on hv-cinder-80447 Feb 21 02:28:48.975683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-9d1a7215-d66b-477a-8d79-e435c5abe414 req-fa125d25-745f-40f0-b5d4-8bf6e892d441 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051809 Feb 21 02:28:48.976404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 122/229] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:28:48.981692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-92c0882f-71d6-4f43-9255-1b9cb5befe15 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:48.982556 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-92c0882f-71d6-4f43-9255-1b9cb5befe15 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:48.989491 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92c0882f-71d6-4f43-9255-1b9cb5befe15 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:48.990170 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92c0882f-71d6-4f43-9255-1b9cb5befe15 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:48.991037 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92c0882f-71d6-4f43-9255-1b9cb5befe15 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:48.991563 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92c0882f-71d6-4f43-9255-1b9cb5befe15 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:49.059113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b0e2b75d-6049-4e7e-8787-aab0663d6e70 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:49.066759 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b0e2b75d-6049-4e7e-8787-aab0663d6e70 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.243864 Feb 21 02:28:49.067375 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 108/230] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:48 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:49.071611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7e468926-7200-41c8-b128-929dab3d616a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:49.072215 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7e468926-7200-41c8-b128-929dab3d616a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:49.077933 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7e468926-7200-41c8-b128-929dab3d616a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:49.078380 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7e468926-7200-41c8-b128-929dab3d616a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:49.079471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7e468926-7200-41c8-b128-929dab3d616a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:49.079951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7e468926-7200-41c8-b128-929dab3d616a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:49.147206 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-92c0882f-71d6-4f43-9255-1b9cb5befe15 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:49.154699 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-92c0882f-71d6-4f43-9255-1b9cb5befe15 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.177049 Feb 21 02:28:49.155202 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 123/231] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:48 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:49.238456 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7e468926-7200-41c8-b128-929dab3d616a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:49.245558 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7e468926-7200-41c8-b128-929dab3d616a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.177270 Feb 21 02:28:49.246149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 109/232] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:49 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:49.358227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:49.358710 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:49.364691 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:49.365221 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:49.366016 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:49.366446 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:49.381179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] HTTP exception thrown: Instance 57db8fe7-822f-4654-af4d-f883ba203764 could not be found. Feb 21 02:28:49.381800 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Returning 404 to user: Instance 57db8fe7-822f-4654-af4d-f883ba203764 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:49.382604 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e02538f0-f3dc-49ab-9f06-c7d758e9d088 tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "DELETE /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 404 len: 111 microversion: 2.1 time: 0.027962 Feb 21 02:28:49.383130 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 124/233] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:28:49 2022] DELETE /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:28:49.390677 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:49.391275 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] [instance: 57db8fe7-822f-4654-af4d-f883ba203764] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:49.397803 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:49.398246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:49.399005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:49.399429 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:49.412411 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] HTTP exception thrown: Instance 57db8fe7-822f-4654-af4d-f883ba203764 could not be found. Feb 21 02:28:49.412915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] Returning 404 to user: Instance 57db8fe7-822f-4654-af4d-f883ba203764 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:49.413744 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-50f15854-b223-4772-97d5-f4997d427b4a tempest-DeleteServersTestJSON-1421956463 tempest-DeleteServersTestJSON-1421956463-project] 10.222.0.75 "GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764" status: 404 len: 111 microversion: 2.1 time: 0.026621 Feb 21 02:28:49.414268 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 110/234] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:49 2022] GET /compute/v2.1/servers/57db8fe7-822f-4654-af4d-f883ba203764 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:28:50.084161 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-92376d5c-e011-44d3-a55a-f386a88f2e94 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:50.084767 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-92376d5c-e011-44d3-a55a-f386a88f2e94 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:50.091420 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92376d5c-e011-44d3-a55a-f386a88f2e94 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:50.091802 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92376d5c-e011-44d3-a55a-f386a88f2e94 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:50.092609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92376d5c-e011-44d3-a55a-f386a88f2e94 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:50.093039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92376d5c-e011-44d3-a55a-f386a88f2e94 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:50.172105 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-decff7ea-9c95-4d9c-9185-6757d7ed6fde tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:50.172831 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-decff7ea-9c95-4d9c-9185-6757d7ed6fde tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:50.180225 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-decff7ea-9c95-4d9c-9185-6757d7ed6fde tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:50.180776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-decff7ea-9c95-4d9c-9185-6757d7ed6fde tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:50.181517 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-decff7ea-9c95-4d9c-9185-6757d7ed6fde tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:50.181984 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-decff7ea-9c95-4d9c-9185-6757d7ed6fde tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:50.235074 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-92376d5c-e011-44d3-a55a-f386a88f2e94 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:50.243177 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-92376d5c-e011-44d3-a55a-f386a88f2e94 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.163054 Feb 21 02:28:50.243750 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 125/235] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:50 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:50.262412 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1c10ae4b-2d57-4fa9-a921-05736d3baa55 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:50.263006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1c10ae4b-2d57-4fa9-a921-05736d3baa55 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:50.268676 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1c10ae4b-2d57-4fa9-a921-05736d3baa55 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:50.269115 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1c10ae4b-2d57-4fa9-a921-05736d3baa55 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:50.269901 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1c10ae4b-2d57-4fa9-a921-05736d3baa55 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:50.270424 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1c10ae4b-2d57-4fa9-a921-05736d3baa55 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:50.342987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-decff7ea-9c95-4d9c-9185-6757d7ed6fde tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:50.351531 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-decff7ea-9c95-4d9c-9185-6757d7ed6fde tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.183190 Feb 21 02:28:50.352095 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 111/236] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:50 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:50.471181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1c10ae4b-2d57-4fa9-a921-05736d3baa55 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:50.480008 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1c10ae4b-2d57-4fa9-a921-05736d3baa55 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.221065 Feb 21 02:28:50.480593 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 126/237] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:50 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:51.261382 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7d086232-4c02-4349-9dcd-c74e41ed52a4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:51.262127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7d086232-4c02-4349-9dcd-c74e41ed52a4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:51.268357 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3d96d6ec-763f-4b0c-a170-005eb11b3b11 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Action: 'create', calling method: .version_select at 0x7fd85c44aee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1992547598", "metadata": {"Type": "work"}}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:51.268793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7d086232-4c02-4349-9dcd-c74e41ed52a4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:51.268793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7d086232-4c02-4349-9dcd-c74e41ed52a4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:51.269564 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7d086232-4c02-4349-9dcd-c74e41ed52a4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:51.269882 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3d96d6ec-763f-4b0c-a170-005eb11b3b11 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:51.270012 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7d086232-4c02-4349-9dcd-c74e41ed52a4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:51.271001 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3d96d6ec-763f-4b0c-a170-005eb11b3b11 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.108747 Feb 21 02:28:51.271517 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 112/238] 10.222.0.75 () {60 vars in 1155 bytes} [Mon Feb 21 02:28:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 02:28:51.280306 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4fdc3e11-5c58-418e-8c3a-9c97de21821d tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Action: 'create', calling method: .version_select at 0x7fd85c2c1af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-783241140", "metadata": {"Type": "work"}}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:51.281679 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4fdc3e11-5c58-418e-8c3a-9c97de21821d tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:51.282461 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4fdc3e11-5c58-418e-8c3a-9c97de21821d tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005601 Feb 21 02:28:51.282966 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 113/239] 10.222.0.75 () {60 vars in 1155 bytes} [Mon Feb 21 02:28:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 21 02:28:51.292640 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-254a736d-135a-4385-9c60-d85b7d05882d tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Action: 'create', calling method: .version_select at 0x7fd85c422040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-523160065", "metadata": {"Type": "work"}}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:28:51.293769 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-254a736d-135a-4385-9c60-d85b7d05882d tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:51.294561 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-254a736d-135a-4385-9c60-d85b7d05882d tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005244 Feb 21 02:28:51.295079 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 114/240] 10.222.0.75 () {60 vars in 1155 bytes} [Mon Feb 21 02:28:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 21 02:28:51.303380 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-32ac3c18-14e2-4467-bab4-ad14536e730f tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Calling method '.version_select at 0x7fd85c32e820>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:51.331421 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-32ac3c18-14e2-4467-bab4-ad14536e730f tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] HTTP exception thrown: Volume tempest-invalid-1851897936 could not be found. Feb 21 02:28:51.332067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-32ac3c18-14e2-4467-bab4-ad14536e730f tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Returning 404 to user: Volume tempest-invalid-1851897936 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:51.332841 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-32ac3c18-14e2-4467-bab4-ad14536e730f tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1851897936" status: 404 len: 99 microversion: 2.1 time: 0.033165 Feb 21 02:28:51.333493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 115/241] 10.222.0.75 () {58 vars in 1217 bytes} [Mon Feb 21 02:28:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1851897936 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 21 02:28:51.342707 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ed8d8658-6ba0-4ead-bce5-97010286693a tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004071 Feb 21 02:28:51.343200 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 116/242] 10.222.0.75 () {58 vars in 1139 bytes} [Mon Feb 21 02:28:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 21 02:28:51.351055 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-14d69d96-ff0e-4fe4-b2a9-f0daa2df2e8d tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003400 Feb 21 02:28:51.352554 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 117/243] 10.222.0.75 () {58 vars in 1136 bytes} [Mon Feb 21 02:28:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 21 02:28:51.359631 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b110a160-f2d0-4acc-a7ed-06693ca08fe3 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Calling method '.version_select at 0x7fd85c45a8b0>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:51.387726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-b110a160-f2d0-4acc-a7ed-06693ca08fe3 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] HTTP exception thrown: Volume f6968bb3-22c2-441c-9e57-a1b2cf822ad8 could not be found. Feb 21 02:28:51.388355 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b110a160-f2d0-4acc-a7ed-06693ca08fe3 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Returning 404 to user: Volume f6968bb3-22c2-441c-9e57-a1b2cf822ad8 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:51.389180 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b110a160-f2d0-4acc-a7ed-06693ca08fe3 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/f6968bb3-22c2-441c-9e57-a1b2cf822ad8" status: 404 len: 109 microversion: 2.1 time: 0.033030 Feb 21 02:28:51.389749 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 118/244] 10.222.0.75 () {58 vars in 1247 bytes} [Mon Feb 21 02:28:51 2022] DELETE /compute/v2.1/os-volumes/f6968bb3-22c2-441c-9e57-a1b2cf822ad8 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 02:28:51.398845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-30eab725-b4ac-471b-8c80-64c6f33928e2 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:51.399445 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-30eab725-b4ac-471b-8c80-64c6f33928e2 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:51.405561 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7d086232-4c02-4349-9dcd-c74e41ed52a4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:51.405856 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-30eab725-b4ac-471b-8c80-64c6f33928e2 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:51.406308 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-30eab725-b4ac-471b-8c80-64c6f33928e2 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:51.407084 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-30eab725-b4ac-471b-8c80-64c6f33928e2 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:51.407514 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-30eab725-b4ac-471b-8c80-64c6f33928e2 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:51.413403 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7d086232-4c02-4349-9dcd-c74e41ed52a4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.155608 Feb 21 02:28:51.414094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 127/245] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:51 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:51.418269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-794ff754-3e21-42de-8bbc-deb5e3dfbeb6 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Calling method '.version_select at 0x7fd85c31c550>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:51.445784 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-794ff754-3e21-42de-8bbc-deb5e3dfbeb6 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] HTTP exception thrown: Volume f849e85a-afdb-443c-b931-125456097a81 could not be found. Feb 21 02:28:51.446499 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-794ff754-3e21-42de-8bbc-deb5e3dfbeb6 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] Returning 404 to user: Volume f849e85a-afdb-443c-b931-125456097a81 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:28:51.447342 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-794ff754-3e21-42de-8bbc-deb5e3dfbeb6 tempest-VolumesNegativeTest-1408388043 tempest-VolumesNegativeTest-1408388043-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/f849e85a-afdb-443c-b931-125456097a81" status: 404 len: 109 microversion: 2.1 time: 0.032286 Feb 21 02:28:51.447883 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 128/246] 10.222.0.75 () {58 vars in 1244 bytes} [Mon Feb 21 02:28:51 2022] GET /compute/v2.1/os-volumes/f849e85a-afdb-443c-b931-125456097a81 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:28:51.497544 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a7215a0d-4008-4849-ac67-e15a246bb6ef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:51.498182 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a7215a0d-4008-4849-ac67-e15a246bb6ef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:51.504742 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a7215a0d-4008-4849-ac67-e15a246bb6ef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:51.505620 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a7215a0d-4008-4849-ac67-e15a246bb6ef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:51.506605 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a7215a0d-4008-4849-ac67-e15a246bb6ef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:51.507028 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a7215a0d-4008-4849-ac67-e15a246bb6ef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:51.543526 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-30eab725-b4ac-471b-8c80-64c6f33928e2 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:51.552797 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-30eab725-b4ac-471b-8c80-64c6f33928e2 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.157405 Feb 21 02:28:51.553953 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 119/247] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:51 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:51.645951 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a7215a0d-4008-4849-ac67-e15a246bb6ef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:51.653251 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a7215a0d-4008-4849-ac67-e15a246bb6ef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.159235 Feb 21 02:28:51.653833 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 129/248] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:51 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:52.430098 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3de0e55a-def5-464b-923a-6f232e4164d8 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:52.430696 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3de0e55a-def5-464b-923a-6f232e4164d8 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:52.436807 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3de0e55a-def5-464b-923a-6f232e4164d8 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:52.437244 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3de0e55a-def5-464b-923a-6f232e4164d8 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:52.438165 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3de0e55a-def5-464b-923a-6f232e4164d8 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:52.438486 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3de0e55a-def5-464b-923a-6f232e4164d8 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:52.569946 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3ed74e86-fc9a-409b-9c0d-478287a08d6c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:52.571105 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3ed74e86-fc9a-409b-9c0d-478287a08d6c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:52.577604 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ed74e86-fc9a-409b-9c0d-478287a08d6c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:52.578087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ed74e86-fc9a-409b-9c0d-478287a08d6c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:52.578878 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ed74e86-fc9a-409b-9c0d-478287a08d6c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:52.579313 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ed74e86-fc9a-409b-9c0d-478287a08d6c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:52.580597 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3de0e55a-def5-464b-923a-6f232e4164d8 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:52.589523 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3de0e55a-def5-464b-923a-6f232e4164d8 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.162794 Feb 21 02:28:52.597866 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 120/249] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:52 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:52.670552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2025a204-2072-4fa3-b271-5fa01dbdcbf9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:52.671365 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2025a204-2072-4fa3-b271-5fa01dbdcbf9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:52.677816 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2025a204-2072-4fa3-b271-5fa01dbdcbf9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:52.678264 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2025a204-2072-4fa3-b271-5fa01dbdcbf9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:52.679080 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2025a204-2072-4fa3-b271-5fa01dbdcbf9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:52.679519 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2025a204-2072-4fa3-b271-5fa01dbdcbf9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:52.722174 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3ed74e86-fc9a-409b-9c0d-478287a08d6c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:52.729712 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3ed74e86-fc9a-409b-9c0d-478287a08d6c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.163930 Feb 21 02:28:52.730292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 130/250] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:52 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:52.815884 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2025a204-2072-4fa3-b271-5fa01dbdcbf9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:52.823397 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2025a204-2072-4fa3-b271-5fa01dbdcbf9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.156414 Feb 21 02:28:52.823970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 121/251] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:52 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:53.606695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b37f34f3-f6ba-4c67-a19f-8a926d8d3d91 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:53.607234 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b37f34f3-f6ba-4c67-a19f-8a926d8d3d91 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:53.613745 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b37f34f3-f6ba-4c67-a19f-8a926d8d3d91 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:53.614374 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b37f34f3-f6ba-4c67-a19f-8a926d8d3d91 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:53.615144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b37f34f3-f6ba-4c67-a19f-8a926d8d3d91 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:53.615577 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b37f34f3-f6ba-4c67-a19f-8a926d8d3d91 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:53.743678 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b37f34f3-f6ba-4c67-a19f-8a926d8d3d91 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:53.746921 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-105c05a1-5fc6-4dbf-adbb-6faa0211e4fa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:53.747527 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-105c05a1-5fc6-4dbf-adbb-6faa0211e4fa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:53.751156 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b37f34f3-f6ba-4c67-a19f-8a926d8d3d91 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.148143 Feb 21 02:28:53.751712 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 131/252] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:53 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:53.753608 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-105c05a1-5fc6-4dbf-adbb-6faa0211e4fa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:53.754088 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-105c05a1-5fc6-4dbf-adbb-6faa0211e4fa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:53.755378 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-105c05a1-5fc6-4dbf-adbb-6faa0211e4fa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:53.755805 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-105c05a1-5fc6-4dbf-adbb-6faa0211e4fa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:53.840167 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-29394550-11a5-4f98-810c-24695b0091f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:53.840675 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-29394550-11a5-4f98-810c-24695b0091f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:53.846816 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-29394550-11a5-4f98-810c-24695b0091f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:53.847263 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-29394550-11a5-4f98-810c-24695b0091f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:53.848032 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-29394550-11a5-4f98-810c-24695b0091f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:53.849023 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-29394550-11a5-4f98-810c-24695b0091f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:53.892686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-105c05a1-5fc6-4dbf-adbb-6faa0211e4fa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:53.900102 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-105c05a1-5fc6-4dbf-adbb-6faa0211e4fa tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.156688 Feb 21 02:28:53.909200 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 122/253] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:53 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:53.983886 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-29394550-11a5-4f98-810c-24695b0091f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:53.991401 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-29394550-11a5-4f98-810c-24695b0091f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.155020 Feb 21 02:28:53.991957 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 132/254] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:53 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:54.768793 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-27ff9edf-c852-4e79-87e9-5892cc4792b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:54.769407 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-27ff9edf-c852-4e79-87e9-5892cc4792b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:54.777139 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27ff9edf-c852-4e79-87e9-5892cc4792b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:54.777710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27ff9edf-c852-4e79-87e9-5892cc4792b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:54.778717 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27ff9edf-c852-4e79-87e9-5892cc4792b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:54.779355 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27ff9edf-c852-4e79-87e9-5892cc4792b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:54.918148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-85b45c57-61c2-462a-8b69-fc9dd164ba69 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:54.919004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-85b45c57-61c2-462a-8b69-fc9dd164ba69 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:54.925626 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85b45c57-61c2-462a-8b69-fc9dd164ba69 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:54.926160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85b45c57-61c2-462a-8b69-fc9dd164ba69 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:54.927168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85b45c57-61c2-462a-8b69-fc9dd164ba69 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:54.927898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85b45c57-61c2-462a-8b69-fc9dd164ba69 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:54.965071 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-27ff9edf-c852-4e79-87e9-5892cc4792b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:54.983660 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-27ff9edf-c852-4e79-87e9-5892cc4792b9 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.219235 Feb 21 02:28:54.984666 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 123/255] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:54 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:55.008229 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4d963c57-6c86-4087-a9dc-ddaab913d790 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:55.008780 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4d963c57-6c86-4087-a9dc-ddaab913d790 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:55.019435 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4d963c57-6c86-4087-a9dc-ddaab913d790 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:55.019902 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4d963c57-6c86-4087-a9dc-ddaab913d790 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:55.021429 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4d963c57-6c86-4087-a9dc-ddaab913d790 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:55.021911 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4d963c57-6c86-4087-a9dc-ddaab913d790 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:55.268416 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-85b45c57-61c2-462a-8b69-fc9dd164ba69 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:55.276759 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-85b45c57-61c2-462a-8b69-fc9dd164ba69 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1313 microversion: 2.1 time: 0.362180 Feb 21 02:28:55.277555 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 133/256] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:54 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:55.280367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4d963c57-6c86-4087-a9dc-ddaab913d790 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:55.287683 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4d963c57-6c86-4087-a9dc-ddaab913d790 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.283277 Feb 21 02:28:55.288249 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 124/257] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:55 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:55.999738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d397bab5-82d0-4904-94c5-482231dddfa2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:56.000336 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d397bab5-82d0-4904-94c5-482231dddfa2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:56.007332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d397bab5-82d0-4904-94c5-482231dddfa2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:56.007778 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d397bab5-82d0-4904-94c5-482231dddfa2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:56.008548 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d397bab5-82d0-4904-94c5-482231dddfa2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:56.008983 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d397bab5-82d0-4904-94c5-482231dddfa2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:56.147630 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d397bab5-82d0-4904-94c5-482231dddfa2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:56.154813 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d397bab5-82d0-4904-94c5-482231dddfa2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.158636 Feb 21 02:28:56.155380 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 134/258] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:55 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:56.293922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-64049d8b-c3c3-437a-9a13-2a3d4739906a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:56.294548 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-64049d8b-c3c3-437a-9a13-2a3d4739906a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:56.301415 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-64049d8b-c3c3-437a-9a13-2a3d4739906a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:56.302822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-64049d8b-c3c3-437a-9a13-2a3d4739906a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:56.303695 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-64049d8b-c3c3-437a-9a13-2a3d4739906a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:56.304353 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-64049d8b-c3c3-437a-9a13-2a3d4739906a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:56.304626 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a24e4066-3e4f-4ed9-9c1a-25fb8ae6c774 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:56.305090 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a24e4066-3e4f-4ed9-9c1a-25fb8ae6c774 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:56.311862 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a24e4066-3e4f-4ed9-9c1a-25fb8ae6c774 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:56.312565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a24e4066-3e4f-4ed9-9c1a-25fb8ae6c774 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:56.313575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a24e4066-3e4f-4ed9-9c1a-25fb8ae6c774 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:56.314121 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a24e4066-3e4f-4ed9-9c1a-25fb8ae6c774 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:56.484951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-64049d8b-c3c3-437a-9a13-2a3d4739906a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:56.493216 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-64049d8b-c3c3-437a-9a13-2a3d4739906a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1498 microversion: 2.1 time: 0.202873 Feb 21 02:28:56.493813 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 125/259] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:56 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:56.505423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a24e4066-3e4f-4ed9-9c1a-25fb8ae6c774 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:56.514875 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a24e4066-3e4f-4ed9-9c1a-25fb8ae6c774 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.213176 Feb 21 02:28:56.515514 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 135/260] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:56 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:28:57.172430 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4fddee0f-a6ee-4b17-a493-3b610178cbcf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:57.173311 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4fddee0f-a6ee-4b17-a493-3b610178cbcf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:57.179879 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4fddee0f-a6ee-4b17-a493-3b610178cbcf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:57.180330 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4fddee0f-a6ee-4b17-a493-3b610178cbcf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:57.181106 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4fddee0f-a6ee-4b17-a493-3b610178cbcf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:57.181534 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4fddee0f-a6ee-4b17-a493-3b610178cbcf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:57.321300 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4fddee0f-a6ee-4b17-a493-3b610178cbcf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:57.329107 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4fddee0f-a6ee-4b17-a493-3b610178cbcf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.161080 Feb 21 02:28:57.329691 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 126/261] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:57 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:57.531752 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a28decea-e054-4dcb-9b1d-b100e0083c3d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:57.532278 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a28decea-e054-4dcb-9b1d-b100e0083c3d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:57.539091 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a28decea-e054-4dcb-9b1d-b100e0083c3d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:57.539705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a28decea-e054-4dcb-9b1d-b100e0083c3d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:57.540636 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a28decea-e054-4dcb-9b1d-b100e0083c3d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:57.541200 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a28decea-e054-4dcb-9b1d-b100e0083c3d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:57.703104 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a28decea-e054-4dcb-9b1d-b100e0083c3d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:57.716691 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a28decea-e054-4dcb-9b1d-b100e0083c3d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.188159 Feb 21 02:28:57.717334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 136/262] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:57 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:57.782329 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f72ad97d-7b4a-4d60-9d26-0835798e1be8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:57.782757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f72ad97d-7b4a-4d60-9d26-0835798e1be8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:57.789517 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f72ad97d-7b4a-4d60-9d26-0835798e1be8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:57.790087 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f72ad97d-7b4a-4d60-9d26-0835798e1be8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:57.791055 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f72ad97d-7b4a-4d60-9d26-0835798e1be8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:57.791589 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f72ad97d-7b4a-4d60-9d26-0835798e1be8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:57.823936 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f72ad97d-7b4a-4d60-9d26-0835798e1be8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:28:57.911383 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f72ad97d-7b4a-4d60-9d26-0835798e1be8 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 204 len: 0 microversion: 2.1 time: 0.132587 Feb 21 02:28:57.911980 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 127/263] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:28:57 2022] DELETE /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:28:57.919775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-00c2f755-67bc-448d-af16-b66290c2db59 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:57.920382 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-00c2f755-67bc-448d-af16-b66290c2db59 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:57.927967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-00c2f755-67bc-448d-af16-b66290c2db59 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:57.928718 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-00c2f755-67bc-448d-af16-b66290c2db59 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:57.929522 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-00c2f755-67bc-448d-af16-b66290c2db59 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:57.929975 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-00c2f755-67bc-448d-af16-b66290c2db59 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:58.092786 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-00c2f755-67bc-448d-af16-b66290c2db59 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:58.101285 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-00c2f755-67bc-448d-af16-b66290c2db59 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1504 microversion: 2.1 time: 0.185044 Feb 21 02:28:58.101992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 137/264] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:57 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:58.347204 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b176b18e-91b4-43ba-9c09-fd12b09ed3d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:58.347914 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b176b18e-91b4-43ba-9c09-fd12b09ed3d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:58.355287 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b176b18e-91b4-43ba-9c09-fd12b09ed3d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:58.355989 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b176b18e-91b4-43ba-9c09-fd12b09ed3d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:58.356956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b176b18e-91b4-43ba-9c09-fd12b09ed3d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:58.357391 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b176b18e-91b4-43ba-9c09-fd12b09ed3d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:58.524190 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b176b18e-91b4-43ba-9c09-fd12b09ed3d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:58.535125 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b176b18e-91b4-43ba-9c09-fd12b09ed3d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.191895 Feb 21 02:28:58.545906 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 128/265] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:58 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:58.734213 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-97b8480b-d4f5-46a6-b251-3ce820d51c65 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:58.735121 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-97b8480b-d4f5-46a6-b251-3ce820d51c65 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:58.741887 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-97b8480b-d4f5-46a6-b251-3ce820d51c65 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:58.742334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-97b8480b-d4f5-46a6-b251-3ce820d51c65 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:58.743293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-97b8480b-d4f5-46a6-b251-3ce820d51c65 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:58.743729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-97b8480b-d4f5-46a6-b251-3ce820d51c65 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:58.883620 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-97b8480b-d4f5-46a6-b251-3ce820d51c65 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:58.890694 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-97b8480b-d4f5-46a6-b251-3ce820d51c65 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.160029 Feb 21 02:28:58.891243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 138/266] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:58 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:59.122242 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-de5ecdbf-3cae-4c57-a676-0920bff1e7eb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:59.122913 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-de5ecdbf-3cae-4c57-a676-0920bff1e7eb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:59.128847 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-de5ecdbf-3cae-4c57-a676-0920bff1e7eb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:59.129378 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-de5ecdbf-3cae-4c57-a676-0920bff1e7eb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:59.130769 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-de5ecdbf-3cae-4c57-a676-0920bff1e7eb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:59.131198 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-de5ecdbf-3cae-4c57-a676-0920bff1e7eb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:59.348915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-de5ecdbf-3cae-4c57-a676-0920bff1e7eb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:59.360463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-de5ecdbf-3cae-4c57-a676-0920bff1e7eb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1504 microversion: 2.1 time: 0.242104 Feb 21 02:28:59.361325 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 129/267] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:59 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:59.553730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b71381df-c8fc-4faa-9f1b-b84cbd11258b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:59.554540 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b71381df-c8fc-4faa-9f1b-b84cbd11258b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:59.560930 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b71381df-c8fc-4faa-9f1b-b84cbd11258b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:59.561369 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b71381df-c8fc-4faa-9f1b-b84cbd11258b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:59.562190 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b71381df-c8fc-4faa-9f1b-b84cbd11258b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:59.562732 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b71381df-c8fc-4faa-9f1b-b84cbd11258b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:59.713572 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b71381df-c8fc-4faa-9f1b-b84cbd11258b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:28:59.721321 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b71381df-c8fc-4faa-9f1b-b84cbd11258b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.171750 Feb 21 02:28:59.721921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 139/268] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:59 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:28:59.906446 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1483b706-2d01-4e89-a648-e38ba7e301c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:28:59.907054 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1483b706-2d01-4e89-a648-e38ba7e301c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:28:59.912900 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1483b706-2d01-4e89-a648-e38ba7e301c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:59.913343 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1483b706-2d01-4e89-a648-e38ba7e301c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:28:59.914149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1483b706-2d01-4e89-a648-e38ba7e301c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:28:59.914572 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1483b706-2d01-4e89-a648-e38ba7e301c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:00.187969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1483b706-2d01-4e89-a648-e38ba7e301c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:00.195419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1483b706-2d01-4e89-a648-e38ba7e301c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.292490 Feb 21 02:29:00.196189 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 130/269] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:28:59 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:00.379372 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8704b6b1-d585-4fce-b866-6159daf17481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:00.381308 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8704b6b1-d585-4fce-b866-6159daf17481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:00.390523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8704b6b1-d585-4fce-b866-6159daf17481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:00.390928 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8704b6b1-d585-4fce-b866-6159daf17481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:00.391780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8704b6b1-d585-4fce-b866-6159daf17481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:00.392213 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8704b6b1-d585-4fce-b866-6159daf17481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:00.563019 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8704b6b1-d585-4fce-b866-6159daf17481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:00.571918 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8704b6b1-d585-4fce-b866-6159daf17481 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1504 microversion: 2.1 time: 0.196517 Feb 21 02:29:00.572778 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 140/270] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:00 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:00.739821 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-144a41c0-4db7-4288-8e28-824b5dfcaaac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:00.741086 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-144a41c0-4db7-4288-8e28-824b5dfcaaac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:00.748063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-144a41c0-4db7-4288-8e28-824b5dfcaaac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:00.748746 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-144a41c0-4db7-4288-8e28-824b5dfcaaac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:00.749785 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-144a41c0-4db7-4288-8e28-824b5dfcaaac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:00.750496 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-144a41c0-4db7-4288-8e28-824b5dfcaaac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:01.213661 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-89f94b8e-21f1-4df6-bbef-7bdd90687a6f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:01.214220 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-89f94b8e-21f1-4df6-bbef-7bdd90687a6f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:01.222911 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89f94b8e-21f1-4df6-bbef-7bdd90687a6f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:01.232497 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89f94b8e-21f1-4df6-bbef-7bdd90687a6f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:01.232497 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89f94b8e-21f1-4df6-bbef-7bdd90687a6f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:01.232497 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89f94b8e-21f1-4df6-bbef-7bdd90687a6f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:01.312015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-144a41c0-4db7-4288-8e28-824b5dfcaaac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:01.322686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-144a41c0-4db7-4288-8e28-824b5dfcaaac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.586815 Feb 21 02:29:01.324028 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 131/271] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:00 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:01.387262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-89f94b8e-21f1-4df6-bbef-7bdd90687a6f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:01.396478 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-89f94b8e-21f1-4df6-bbef-7bdd90687a6f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.187292 Feb 21 02:29:01.397064 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 141/272] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:01 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:01.589775 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d692c778-c3cb-4ac6-9319-5670acf87434 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:01.590620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d692c778-c3cb-4ac6-9319-5670acf87434 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:01.598002 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d692c778-c3cb-4ac6-9319-5670acf87434 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:01.599175 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d692c778-c3cb-4ac6-9319-5670acf87434 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:01.600130 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d692c778-c3cb-4ac6-9319-5670acf87434 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:01.600706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d692c778-c3cb-4ac6-9319-5670acf87434 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:01.755129 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d692c778-c3cb-4ac6-9319-5670acf87434 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:01.764422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d692c778-c3cb-4ac6-9319-5670acf87434 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1504 microversion: 2.1 time: 0.178139 Feb 21 02:29:01.775662 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 132/273] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:01 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:02.340593 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8118b71c-83ae-4c82-bdb3-5f78c77c7827 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:02.341580 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8118b71c-83ae-4c82-bdb3-5f78c77c7827 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:02.347542 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8118b71c-83ae-4c82-bdb3-5f78c77c7827 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:02.348206 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8118b71c-83ae-4c82-bdb3-5f78c77c7827 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:02.349330 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8118b71c-83ae-4c82-bdb3-5f78c77c7827 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:02.349946 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8118b71c-83ae-4c82-bdb3-5f78c77c7827 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:02.412951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ff0d7811-5f4a-4157-af0b-5b43609d0671 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:02.413736 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ff0d7811-5f4a-4157-af0b-5b43609d0671 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:02.421092 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ff0d7811-5f4a-4157-af0b-5b43609d0671 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:02.421611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ff0d7811-5f4a-4157-af0b-5b43609d0671 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:02.422559 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ff0d7811-5f4a-4157-af0b-5b43609d0671 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:02.423178 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ff0d7811-5f4a-4157-af0b-5b43609d0671 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:02.584804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ff0d7811-5f4a-4157-af0b-5b43609d0671 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:02.604008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ff0d7811-5f4a-4157-af0b-5b43609d0671 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.195188 Feb 21 02:29:02.604595 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 133/274] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:02 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:02.631504 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8118b71c-83ae-4c82-bdb3-5f78c77c7827 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:02.640390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8118b71c-83ae-4c82-bdb3-5f78c77c7827 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.303912 Feb 21 02:29:02.649815 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 142/275] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:02 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:02.782981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8fa9facf-1580-48f2-9b40-7749c8ca75b5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:02.783615 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8fa9facf-1580-48f2-9b40-7749c8ca75b5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:02.797740 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8fa9facf-1580-48f2-9b40-7749c8ca75b5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:02.800040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8fa9facf-1580-48f2-9b40-7749c8ca75b5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:02.800849 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8fa9facf-1580-48f2-9b40-7749c8ca75b5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:02.802027 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8fa9facf-1580-48f2-9b40-7749c8ca75b5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:03.052651 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8fa9facf-1580-48f2-9b40-7749c8ca75b5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:03.062745 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8fa9facf-1580-48f2-9b40-7749c8ca75b5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1504 microversion: 2.1 time: 0.283799 Feb 21 02:29:03.063614 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 134/276] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:02 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:03.620501 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f9eac365-a913-469d-86fa-c22be9ef90f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:03.621533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f9eac365-a913-469d-86fa-c22be9ef90f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:03.630791 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f9eac365-a913-469d-86fa-c22be9ef90f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:03.631242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f9eac365-a913-469d-86fa-c22be9ef90f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:03.639247 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f9eac365-a913-469d-86fa-c22be9ef90f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:03.639871 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f9eac365-a913-469d-86fa-c22be9ef90f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:03.657721 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d2aa4e8b-47c2-49da-b197-58e1f6f0d02d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:03.658350 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d2aa4e8b-47c2-49da-b197-58e1f6f0d02d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:03.671472 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d2aa4e8b-47c2-49da-b197-58e1f6f0d02d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:03.671591 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d2aa4e8b-47c2-49da-b197-58e1f6f0d02d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:03.672404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d2aa4e8b-47c2-49da-b197-58e1f6f0d02d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:03.679544 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d2aa4e8b-47c2-49da-b197-58e1f6f0d02d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:03.939210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f9eac365-a913-469d-86fa-c22be9ef90f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:03.953796 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f9eac365-a913-469d-86fa-c22be9ef90f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.332626 Feb 21 02:29:03.954620 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 143/277] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:03 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:04.082075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-de07d0f6-ef57-4083-bb5c-32c9fae61329 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:04.083481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-de07d0f6-ef57-4083-bb5c-32c9fae61329 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:04.099310 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-de07d0f6-ef57-4083-bb5c-32c9fae61329 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:04.099976 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-de07d0f6-ef57-4083-bb5c-32c9fae61329 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:04.100904 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-de07d0f6-ef57-4083-bb5c-32c9fae61329 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:04.101442 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-de07d0f6-ef57-4083-bb5c-32c9fae61329 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:04.299980 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d2aa4e8b-47c2-49da-b197-58e1f6f0d02d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:04.306085 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-de07d0f6-ef57-4083-bb5c-32c9fae61329 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:04.307863 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d2aa4e8b-47c2-49da-b197-58e1f6f0d02d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.653952 Feb 21 02:29:04.308447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 135/278] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:03 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:04.316062 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-de07d0f6-ef57-4083-bb5c-32c9fae61329 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 200 len: 1462 microversion: 2.1 time: 0.237290 Feb 21 02:29:04.327923 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 144/279] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:04 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 1462 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:04.330410 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-a0ee6cca-0482-4a2a-b29c-588907abc33c req-f57307ab-6067-41f9-be88-40f93c4c0f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f795772e-0d14-4397-8f5f-62af0cb15233", "name": "network-vif-deleted", "tag": "0918eaa1-3a14-404c-9caf-d4c22252c6fe"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:04.339650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:29:04.339650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:29:04.346885 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-a0ee6cca-0482-4a2a-b29c-588907abc33c req-f57307ab-6067-41f9-be88-40f93c4c0f2b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:04.347588 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-a0ee6cca-0482-4a2a-b29c-588907abc33c req-f57307ab-6067-41f9-be88-40f93c4c0f2b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:04.369032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-a0ee6cca-0482-4a2a-b29c-588907abc33c req-f57307ab-6067-41f9-be88-40f93c4c0f2b service nova] Creating event network-vif-deleted:0918eaa1-3a14-404c-9caf-d4c22252c6fe for instance f795772e-0d14-4397-8f5f-62af0cb15233 on hv-cinder-80447 Feb 21 02:29:04.374093 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-a0ee6cca-0482-4a2a-b29c-588907abc33c req-f57307ab-6067-41f9-be88-40f93c4c0f2b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054709 Feb 21 02:29:04.374897 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 136/280] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:04.472943 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-cb4cab41-e46e-41c4-b1b2-e01292b603b2 req-1e4c8eb1-ac10-46c8-867c-ccf95c578a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb", "name": "network-vif-plugged", "status": "completed", "tag": "b84a1600-9302-43ac-8004-61bd10577802"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:04.476013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:29:04.476013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:29:04.483653 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-cb4cab41-e46e-41c4-b1b2-e01292b603b2 req-1e4c8eb1-ac10-46c8-867c-ccf95c578a61 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:04.484249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-cb4cab41-e46e-41c4-b1b2-e01292b603b2 req-1e4c8eb1-ac10-46c8-867c-ccf95c578a61 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:04.499334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-cb4cab41-e46e-41c4-b1b2-e01292b603b2 req-1e4c8eb1-ac10-46c8-867c-ccf95c578a61 service nova] Creating event network-vif-plugged:b84a1600-9302-43ac-8004-61bd10577802 for instance c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb on hv-cinder-80447 Feb 21 02:29:04.508963 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-cb4cab41-e46e-41c4-b1b2-e01292b603b2 req-1e4c8eb1-ac10-46c8-867c-ccf95c578a61 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040804 Feb 21 02:29:04.509828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 145/281] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:04.975970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fa4aec5e-b42b-475e-99ea-d3a106e6cef6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:04.976161 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fa4aec5e-b42b-475e-99ea-d3a106e6cef6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:05.030372 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fa4aec5e-b42b-475e-99ea-d3a106e6cef6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:05.037260 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fa4aec5e-b42b-475e-99ea-d3a106e6cef6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:05.039305 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fa4aec5e-b42b-475e-99ea-d3a106e6cef6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:05.039564 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fa4aec5e-b42b-475e-99ea-d3a106e6cef6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:05.331376 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0d6bca1c-6404-4d87-909a-2e6bb1d6d0ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:05.333472 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0d6bca1c-6404-4d87-909a-2e6bb1d6d0ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:05.362241 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0d6bca1c-6404-4d87-909a-2e6bb1d6d0ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:05.363064 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0d6bca1c-6404-4d87-909a-2e6bb1d6d0ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:05.365525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fa4aec5e-b42b-475e-99ea-d3a106e6cef6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:05.370936 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0d6bca1c-6404-4d87-909a-2e6bb1d6d0ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:05.373158 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0d6bca1c-6404-4d87-909a-2e6bb1d6d0ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:05.380748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fa4aec5e-b42b-475e-99ea-d3a106e6cef6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.413351 Feb 21 02:29:05.381963 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 137/282] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:04 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:05.397352 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:05.398751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: f795772e-0d14-4397-8f5f-62af0cb15233] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:05.409884 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:05.411129 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:05.412666 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:05.412953 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:05.441969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] HTTP exception thrown: Instance f795772e-0d14-4397-8f5f-62af0cb15233 could not be found. Feb 21 02:29:05.442859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Returning 404 to user: Instance f795772e-0d14-4397-8f5f-62af0cb15233 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:29:05.443953 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-cc6f5091-e798-4c72-bcc0-1df0e08eca32 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233" status: 404 len: 111 microversion: 2.1 time: 0.060896 Feb 21 02:29:05.444520 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 138/283] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:05 2022] GET /compute/v2.1/servers/f795772e-0d14-4397-8f5f-62af0cb15233 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:29:05.560419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1541040331", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "47902730-a416-4a1e-a09f-8dbc18c262d4"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:05.619778 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] validate_networks() for [('47902730-a416-4a1e-a09f-8dbc18c262d4', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:29:05.824007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0d6bca1c-6404-4d87-909a-2e6bb1d6d0ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:05.836974 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0d6bca1c-6404-4d87-909a-2e6bb1d6d0ab tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.514450 Feb 21 02:29:05.837912 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 146/284] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:05 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:06.008583 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:29:06.009001 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:29:06.009462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:29:06.009889 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:29:06.010450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:29:06.020917 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:06.021458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:06.022302 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:06.022866 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:06.042109 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Getting quotas for project ebe91b074cd3444ea5b8e2a29179016d. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:29:06.046834 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Getting quotas for user bc9cadc548ce4093a9e1f749e5e7375c and project ebe91b074cd3444ea5b8e2a29179016d. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:29:06.059500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:29:06.062042 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:29:06.116519 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-01071ece-788e-406a-b02c-9753f5c2573c tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560044 Feb 21 02:29:06.117500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 139/285] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 02:29:06.126872 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9bab1b7f-ab85-4678-8cf1-f2fab6964daf tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:06.127656 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9bab1b7f-ab85-4678-8cf1-f2fab6964daf tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:06.257591 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9bab1b7f-ab85-4678-8cf1-f2fab6964daf tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:06.270393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9bab1b7f-ab85-4678-8cf1-f2fab6964daf tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1214 microversion: 2.1 time: 0.144075 Feb 21 02:29:06.276920 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 147/286] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:06 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:06.398836 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-62b87b89-1abb-473d-adbb-4136b3915604 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:06.399513 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-62b87b89-1abb-473d-adbb-4136b3915604 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:06.415347 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62b87b89-1abb-473d-adbb-4136b3915604 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:06.418009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62b87b89-1abb-473d-adbb-4136b3915604 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:06.421747 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62b87b89-1abb-473d-adbb-4136b3915604 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:06.422724 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62b87b89-1abb-473d-adbb-4136b3915604 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:06.674750 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-62b87b89-1abb-473d-adbb-4136b3915604 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:06.684242 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-62b87b89-1abb-473d-adbb-4136b3915604 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.290400 Feb 21 02:29:06.685541 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 140/287] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:06 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:06.855557 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-48dd6916-7d92-46ce-9ba8-a2a7feb2491d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:06.856392 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-48dd6916-7d92-46ce-9ba8-a2a7feb2491d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:06.870204 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-48dd6916-7d92-46ce-9ba8-a2a7feb2491d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:06.871834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-48dd6916-7d92-46ce-9ba8-a2a7feb2491d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:06.881032 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-48dd6916-7d92-46ce-9ba8-a2a7feb2491d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:06.881877 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-48dd6916-7d92-46ce-9ba8-a2a7feb2491d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:07.295628 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4fdcdcf7-2fff-44df-8ac3-7ce627cbeef1 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:07.296480 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4fdcdcf7-2fff-44df-8ac3-7ce627cbeef1 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:07.307515 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4fdcdcf7-2fff-44df-8ac3-7ce627cbeef1 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:07.308196 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4fdcdcf7-2fff-44df-8ac3-7ce627cbeef1 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:07.309478 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4fdcdcf7-2fff-44df-8ac3-7ce627cbeef1 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:07.310182 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4fdcdcf7-2fff-44df-8ac3-7ce627cbeef1 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:07.409631 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4fdcdcf7-2fff-44df-8ac3-7ce627cbeef1 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:07.418354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4fdcdcf7-2fff-44df-8ac3-7ce627cbeef1 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1218 microversion: 2.1 time: 0.128861 Feb 21 02:29:07.418996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 141/288] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:07 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:07.463913 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-48dd6916-7d92-46ce-9ba8-a2a7feb2491d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:07.483546 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-48dd6916-7d92-46ce-9ba8-a2a7feb2491d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.630587 Feb 21 02:29:07.494492 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 148/289] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:06 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:07.701521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d8bbedd4-6402-44be-bcd4-7def9e9f2a5d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:07.702167 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d8bbedd4-6402-44be-bcd4-7def9e9f2a5d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:07.717240 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d8bbedd4-6402-44be-bcd4-7def9e9f2a5d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:07.717714 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d8bbedd4-6402-44be-bcd4-7def9e9f2a5d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:07.718512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d8bbedd4-6402-44be-bcd4-7def9e9f2a5d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:07.718945 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d8bbedd4-6402-44be-bcd4-7def9e9f2a5d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:07.962390 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d8bbedd4-6402-44be-bcd4-7def9e9f2a5d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:07.975305 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d8bbedd4-6402-44be-bcd4-7def9e9f2a5d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.277381 Feb 21 02:29:07.976512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 142/290] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:07 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:08.438364 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5a34a668-ba70-4435-b3d2-c42c4536f2b0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:08.439178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5a34a668-ba70-4435-b3d2-c42c4536f2b0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:08.452172 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5a34a668-ba70-4435-b3d2-c42c4536f2b0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:08.455259 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5a34a668-ba70-4435-b3d2-c42c4536f2b0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:08.456790 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5a34a668-ba70-4435-b3d2-c42c4536f2b0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:08.458737 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5a34a668-ba70-4435-b3d2-c42c4536f2b0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:08.501745 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c4296fbe-2888-47d5-8b0e-5d56deef5701 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:08.503705 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c4296fbe-2888-47d5-8b0e-5d56deef5701 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:08.518030 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c4296fbe-2888-47d5-8b0e-5d56deef5701 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:08.520273 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c4296fbe-2888-47d5-8b0e-5d56deef5701 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:08.528515 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c4296fbe-2888-47d5-8b0e-5d56deef5701 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:08.530445 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c4296fbe-2888-47d5-8b0e-5d56deef5701 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:08.703949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5a34a668-ba70-4435-b3d2-c42c4536f2b0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:08.715090 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5a34a668-ba70-4435-b3d2-c42c4536f2b0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1210 microversion: 2.1 time: 0.281916 Feb 21 02:29:08.716000 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 149/291] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:08 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1210 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:08.992592 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-38cda9fd-0a99-4da3-a194-3d4ed0620338 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:08.993705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-38cda9fd-0a99-4da3-a194-3d4ed0620338 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:09.005952 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38cda9fd-0a99-4da3-a194-3d4ed0620338 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:09.007485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38cda9fd-0a99-4da3-a194-3d4ed0620338 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:09.008523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38cda9fd-0a99-4da3-a194-3d4ed0620338 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:09.010110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38cda9fd-0a99-4da3-a194-3d4ed0620338 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:09.048216 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c4296fbe-2888-47d5-8b0e-5d56deef5701 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:09.059658 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c4296fbe-2888-47d5-8b0e-5d56deef5701 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.562651 Feb 21 02:29:09.063373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 143/292] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:08 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:09.341208 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-38cda9fd-0a99-4da3-a194-3d4ed0620338 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:09.352991 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-38cda9fd-0a99-4da3-a194-3d4ed0620338 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 0.364311 Feb 21 02:29:09.353586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 150/293] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:08 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:09.734197 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-02169596-35da-48df-b257-43f9d7e0b7bb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:09.736240 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-02169596-35da-48df-b257-43f9d7e0b7bb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:09.755493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02169596-35da-48df-b257-43f9d7e0b7bb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:09.755676 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02169596-35da-48df-b257-43f9d7e0b7bb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:09.761314 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02169596-35da-48df-b257-43f9d7e0b7bb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:09.763604 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02169596-35da-48df-b257-43f9d7e0b7bb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:09.959689 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-02169596-35da-48df-b257-43f9d7e0b7bb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:09.968051 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-02169596-35da-48df-b257-43f9d7e0b7bb tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1266 microversion: 2.1 time: 0.237934 Feb 21 02:29:09.976207 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 144/294] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:09 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:10.080880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c2b42450-8634-4a8e-94a2-1c01bb5f3773 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:10.081489 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c2b42450-8634-4a8e-94a2-1c01bb5f3773 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:10.092475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c2b42450-8634-4a8e-94a2-1c01bb5f3773 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:10.094052 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c2b42450-8634-4a8e-94a2-1c01bb5f3773 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:10.094880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c2b42450-8634-4a8e-94a2-1c01bb5f3773 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:10.097482 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c2b42450-8634-4a8e-94a2-1c01bb5f3773 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:10.376072 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ca56a878-388a-454b-820f-4d00e664031e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:10.377163 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ca56a878-388a-454b-820f-4d00e664031e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:10.413976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca56a878-388a-454b-820f-4d00e664031e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:10.421889 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca56a878-388a-454b-820f-4d00e664031e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:10.422744 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca56a878-388a-454b-820f-4d00e664031e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:10.423184 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca56a878-388a-454b-820f-4d00e664031e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:10.502105 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c2b42450-8634-4a8e-94a2-1c01bb5f3773 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:10.514192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c2b42450-8634-4a8e-94a2-1c01bb5f3773 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.437464 Feb 21 02:29:10.519527 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 151/295] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:10 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:10.992394 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8f9a3efe-238a-4dc3-8494-9f0f63382524 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:10.998387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8f9a3efe-238a-4dc3-8494-9f0f63382524 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:11.023773 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8f9a3efe-238a-4dc3-8494-9f0f63382524 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:11.025144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8f9a3efe-238a-4dc3-8494-9f0f63382524 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:11.026914 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8f9a3efe-238a-4dc3-8494-9f0f63382524 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:11.030796 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8f9a3efe-238a-4dc3-8494-9f0f63382524 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:11.225859 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8f9a3efe-238a-4dc3-8494-9f0f63382524 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:11.233838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8f9a3efe-238a-4dc3-8494-9f0f63382524 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1272 microversion: 2.1 time: 0.246071 Feb 21 02:29:11.244681 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 152/296] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:10 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:11.535426 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-297105d3-3889-44d8-9d38-f7bbba0b43eb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:11.536731 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-297105d3-3889-44d8-9d38-f7bbba0b43eb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:11.555238 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-297105d3-3889-44d8-9d38-f7bbba0b43eb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:11.556672 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-297105d3-3889-44d8-9d38-f7bbba0b43eb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:11.560560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-297105d3-3889-44d8-9d38-f7bbba0b43eb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:11.562567 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-297105d3-3889-44d8-9d38-f7bbba0b43eb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:11.804141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-297105d3-3889-44d8-9d38-f7bbba0b43eb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:11.826598 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-297105d3-3889-44d8-9d38-f7bbba0b43eb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.297458 Feb 21 02:29:11.830025 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 153/297] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:11 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:11.894009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ca56a878-388a-454b-820f-4d00e664031e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:11.907993 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ca56a878-388a-454b-820f-4d00e664031e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1317 microversion: 2.1 time: 1.539968 Feb 21 02:29:11.909289 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 145/298] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:10 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1317 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:12.255986 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-04747a04-8cef-4b4e-9a6a-68913daaf79e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:12.257148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-04747a04-8cef-4b4e-9a6a-68913daaf79e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:12.265915 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04747a04-8cef-4b4e-9a6a-68913daaf79e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:12.266629 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04747a04-8cef-4b4e-9a6a-68913daaf79e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:12.267676 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04747a04-8cef-4b4e-9a6a-68913daaf79e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:12.268382 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04747a04-8cef-4b4e-9a6a-68913daaf79e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:12.378417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-04747a04-8cef-4b4e-9a6a-68913daaf79e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:12.389878 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-04747a04-8cef-4b4e-9a6a-68913daaf79e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1272 microversion: 2.1 time: 0.141384 Feb 21 02:29:12.401945 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 154/299] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:12 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:12.850726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5cb0e6f6-407e-45ba-b535-5c6e67c5dbb3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:12.851358 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5cb0e6f6-407e-45ba-b535-5c6e67c5dbb3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:12.862830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5cb0e6f6-407e-45ba-b535-5c6e67c5dbb3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:12.863374 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5cb0e6f6-407e-45ba-b535-5c6e67c5dbb3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:12.865229 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5cb0e6f6-407e-45ba-b535-5c6e67c5dbb3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:12.871357 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5cb0e6f6-407e-45ba-b535-5c6e67c5dbb3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:12.937781 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3482d8e2-6698-4afe-adfd-c912bcd0a466 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:12.939338 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3482d8e2-6698-4afe-adfd-c912bcd0a466 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:12.950333 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3482d8e2-6698-4afe-adfd-c912bcd0a466 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:12.951210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3482d8e2-6698-4afe-adfd-c912bcd0a466 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:12.952393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3482d8e2-6698-4afe-adfd-c912bcd0a466 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:12.952985 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3482d8e2-6698-4afe-adfd-c912bcd0a466 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.220029 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3482d8e2-6698-4afe-adfd-c912bcd0a466 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:13.229285 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3482d8e2-6698-4afe-adfd-c912bcd0a466 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1507 microversion: 2.1 time: 0.307711 Feb 21 02:29:13.231319 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 155/300] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:12 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:13.258681 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2b98e53-a104-4cf0-88a1-b2cadce1bb36"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:13.260340 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:13.276595 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:13.277060 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.279243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:13.279944 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.428742 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5cb0e6f6-407e-45ba-b535-5c6e67c5dbb3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:13.438792 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] HTTP exception thrown: Invalid volume: volume b2b98e53-a104-4cf0-88a1-b2cadce1bb36 is already attached to instances: f2034fae-347a-4500-8cbf-606b03dcfcc5 Feb 21 02:29:13.439390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Returning 400 to user: Invalid volume: volume b2b98e53-a104-4cf0-88a1-b2cadce1bb36 is already attached to instances: f2034fae-347a-4500-8cbf-606b03dcfcc5 {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:29:13.440013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5cb0e6f6-407e-45ba-b535-5c6e67c5dbb3 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1521 microversion: 2.1 time: 0.595269 Feb 21 02:29:13.440207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7e795180-f11b-4ad4-afb7-77d875b90a8d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.195170 Feb 21 02:29:13.440988 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 146/301] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:12 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:13.447556 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d240f9b9-01ee-45c3-bc38-3921453c0091 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:13.448476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d240f9b9-01ee-45c3-bc38-3921453c0091 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:13.449933 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 156/302] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:29:13 2022] POST /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb/os-volume_attachments => generated 174 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 02:29:13.463110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d240f9b9-01ee-45c3-bc38-3921453c0091 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:13.463110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d240f9b9-01ee-45c3-bc38-3921453c0091 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.463110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d240f9b9-01ee-45c3-bc38-3921453c0091 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:13.463110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d240f9b9-01ee-45c3-bc38-3921453c0091 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.553715 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4e6c75ce-cba9-4c37-9e14-bf8f584b8c24 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:13.554142 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4e6c75ce-cba9-4c37-9e14-bf8f584b8c24 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:13.566106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4e6c75ce-cba9-4c37-9e14-bf8f584b8c24 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:13.567217 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4e6c75ce-cba9-4c37-9e14-bf8f584b8c24 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.568030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4e6c75ce-cba9-4c37-9e14-bf8f584b8c24 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:13.568463 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4e6c75ce-cba9-4c37-9e14-bf8f584b8c24 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.736888 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-4e6c75ce-cba9-4c37-9e14-bf8f584b8c24 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'services' on Instance uuid f2034fae-347a-4500-8cbf-606b03dcfcc5 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:29:13.877459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4e6c75ce-cba9-4c37-9e14-bf8f584b8c24 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments/b2b98e53-a104-4cf0-88a1-b2cadce1bb36" status: 202 len: 0 microversion: 2.1 time: 0.329118 Feb 21 02:29:13.883662 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 157/303] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:29:13 2022] DELETE /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments/b2b98e53-a104-4cf0-88a1-b2cadce1bb36 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 02:29:13.889034 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-37d44baf-e075-4b9a-9c12-691f3249215a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:13.896307 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-37d44baf-e075-4b9a-9c12-691f3249215a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:13.913482 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-37d44baf-e075-4b9a-9c12-691f3249215a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:13.915664 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-37d44baf-e075-4b9a-9c12-691f3249215a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.916828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-37d44baf-e075-4b9a-9c12-691f3249215a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:13.917274 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-37d44baf-e075-4b9a-9c12-691f3249215a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:13.965689 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-37d44baf-e075-4b9a-9c12-691f3249215a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080245 Feb 21 02:29:13.973178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 158/304] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:13 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:13.999972 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d240f9b9-01ee-45c3-bc38-3921453c0091 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:14.009874 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d240f9b9-01ee-45c3-bc38-3921453c0091 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.567115 Feb 21 02:29:14.011286 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 147/305] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:13 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:14.459752 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2f3d4ca4-21f8-4d26-b15a-b2145b26e6f2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:14.460268 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2f3d4ca4-21f8-4d26-b15a-b2145b26e6f2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:14.466616 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2f3d4ca4-21f8-4d26-b15a-b2145b26e6f2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:14.467107 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2f3d4ca4-21f8-4d26-b15a-b2145b26e6f2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:14.468352 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2f3d4ca4-21f8-4d26-b15a-b2145b26e6f2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:14.468941 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2f3d4ca4-21f8-4d26-b15a-b2145b26e6f2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:14.633178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2f3d4ca4-21f8-4d26-b15a-b2145b26e6f2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:14.644292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2f3d4ca4-21f8-4d26-b15a-b2145b26e6f2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1501 microversion: 2.1 time: 0.189233 Feb 21 02:29:14.647104 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 159/306] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:14 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:14.662724 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-113d498b-7e92-406d-afbd-a1c2964232ee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:14.669138 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-113d498b-7e92-406d-afbd-a1c2964232ee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:14.679251 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-113d498b-7e92-406d-afbd-a1c2964232ee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:14.679699 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-113d498b-7e92-406d-afbd-a1c2964232ee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:14.680912 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-113d498b-7e92-406d-afbd-a1c2964232ee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:14.681528 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-113d498b-7e92-406d-afbd-a1c2964232ee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:14.979134 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dda6ac8e-f35b-4baf-af09-244d2ceea703 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:14.980042 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dda6ac8e-f35b-4baf-af09-244d2ceea703 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:14.991675 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dda6ac8e-f35b-4baf-af09-244d2ceea703 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:14.992235 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dda6ac8e-f35b-4baf-af09-244d2ceea703 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:14.993256 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dda6ac8e-f35b-4baf-af09-244d2ceea703 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:14.993961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dda6ac8e-f35b-4baf-af09-244d2ceea703 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:15.038004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dda6ac8e-f35b-4baf-af09-244d2ceea703 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063612 Feb 21 02:29:15.042160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 160/307] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:14 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:29:15.046746 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-89b6de6e-5c35-435b-8fa2-e16dba21da2e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:15.047526 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-89b6de6e-5c35-435b-8fa2-e16dba21da2e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:15.055470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89b6de6e-5c35-435b-8fa2-e16dba21da2e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:15.055910 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89b6de6e-5c35-435b-8fa2-e16dba21da2e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:15.056696 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89b6de6e-5c35-435b-8fa2-e16dba21da2e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:15.057122 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89b6de6e-5c35-435b-8fa2-e16dba21da2e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:15.145698 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-113d498b-7e92-406d-afbd-a1c2964232ee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:15.154966 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-113d498b-7e92-406d-afbd-a1c2964232ee tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1515 microversion: 2.1 time: 0.496167 Feb 21 02:29:15.167009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 148/308] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:14 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1515 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:15.167009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-d55c1734-143e-48f0-a9ab-ea8667922d2a req-e0001c7a-6b33-4c30-a36a-a490c638a019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "813e8757-d323-4bbc-89e9-d7a687663a8f", "tag": "13e94cd1-063a-4c40-9c82-feb80fe73d30"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:15.167009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:29:15.167009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:29:15.183521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-d55c1734-143e-48f0-a9ab-ea8667922d2a req-e0001c7a-6b33-4c30-a36a-a490c638a019 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:15.184370 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-d55c1734-143e-48f0-a9ab-ea8667922d2a req-e0001c7a-6b33-4c30-a36a-a490c638a019 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:15.200298 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-d55c1734-143e-48f0-a9ab-ea8667922d2a req-e0001c7a-6b33-4c30-a36a-a490c638a019 service nova] Creating event network-changed:13e94cd1-063a-4c40-9c82-feb80fe73d30 for instance 813e8757-d323-4bbc-89e9-d7a687663a8f on hv-cinder-80447 Feb 21 02:29:15.205521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-d55c1734-143e-48f0-a9ab-ea8667922d2a req-e0001c7a-6b33-4c30-a36a-a490c638a019 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048380 Feb 21 02:29:15.206615 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 149/309] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:15.272272 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-89b6de6e-5c35-435b-8fa2-e16dba21da2e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:15.286655 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-89b6de6e-5c35-435b-8fa2-e16dba21da2e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.242986 Feb 21 02:29:15.288273 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 161/310] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:15 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:15.846987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c4abebf9-1a34-48a3-8ab1-3301a5e28824 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Action: 'create', calling method: .version_select at 0x7fd85c31df70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1832202538"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:15.881281 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-c4abebf9-1a34-48a3-8ab1-3301a5e28824 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Getting quotas for project 2c955ce069224b53aa944c7971e3650c. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:29:15.900097 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-c4abebf9-1a34-48a3-8ab1-3301a5e28824 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Getting quotas for user 4941ffa30a3740608a9d46b546ba6f6d and project 2c955ce069224b53aa944c7971e3650c. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:29:16.051978 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6a8f413f-7967-4e0a-81c8-f942bc2e4530 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:16.055864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6a8f413f-7967-4e0a-81c8-f942bc2e4530 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:16.066994 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6a8f413f-7967-4e0a-81c8-f942bc2e4530 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:16.068364 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6a8f413f-7967-4e0a-81c8-f942bc2e4530 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:16.073685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6a8f413f-7967-4e0a-81c8-f942bc2e4530 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:16.075320 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6a8f413f-7967-4e0a-81c8-f942bc2e4530 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:16.139919 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6a8f413f-7967-4e0a-81c8-f942bc2e4530 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092579 Feb 21 02:29:16.142352 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 162/311] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:16 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 02:29:16.282738 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-c4abebf9-1a34-48a3-8ab1-3301a5e28824 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Getting quotas for project 2c955ce069224b53aa944c7971e3650c. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:29:16.290210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-c4abebf9-1a34-48a3-8ab1-3301a5e28824 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Getting quotas for user 4941ffa30a3740608a9d46b546ba6f6d and project 2c955ce069224b53aa944c7971e3650c. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:29:16.314352 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a2820c74-d347-4519-96e9-b6dc488e367f tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:16.315685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a2820c74-d347-4519-96e9-b6dc488e367f tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:16.336201 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a2820c74-d347-4519-96e9-b6dc488e367f tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:16.336654 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a2820c74-d347-4519-96e9-b6dc488e367f tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:16.337439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a2820c74-d347-4519-96e9-b6dc488e367f tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:16.337902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a2820c74-d347-4519-96e9-b6dc488e367f tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:16.346271 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c4abebf9-1a34-48a3-8ab1-3301a5e28824 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.889810 Feb 21 02:29:16.354099 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 150/312] 10.222.0.75 () {60 vars in 1157 bytes} [Mon Feb 21 02:29:15 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:16.510684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1553137877", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "d4d7fbe4-b74f-4889-adca-b065ca5bd2cf"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:16.605047 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] validate_networks() for [('d4d7fbe4-b74f-4889-adca-b065ca5bd2cf', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:29:16.762815 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a2820c74-d347-4519-96e9-b6dc488e367f tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:16.773376 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a2820c74-d347-4519-96e9-b6dc488e367f tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.471609 Feb 21 02:29:16.777994 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 163/313] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:16 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:16.816982 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5a1018b2-4db5-4fc5-b9b7-5b492d0fa7c0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:16.818066 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5a1018b2-4db5-4fc5-b9b7-5b492d0fa7c0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:16.833470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5a1018b2-4db5-4fc5-b9b7-5b492d0fa7c0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:16.833962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5a1018b2-4db5-4fc5-b9b7-5b492d0fa7c0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:16.834816 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5a1018b2-4db5-4fc5-b9b7-5b492d0fa7c0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:16.835121 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5a1018b2-4db5-4fc5-b9b7-5b492d0fa7c0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:16.906528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-5a1018b2-4db5-4fc5-b9b7-5b492d0fa7c0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lazy-loading 'flavor' on Instance uuid 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:29:17.071472 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5a1018b2-4db5-4fc5-b9b7-5b492d0fa7c0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/action" status: 200 len: 32 microversion: 2.1 time: 0.258551 Feb 21 02:29:17.072435 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 164/314] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:29:16 2022] POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 02:29:17.095351 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9182e7b1-828b-4441-9e58-290c28b7a790 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:17.102290 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9182e7b1-828b-4441-9e58-290c28b7a790 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:17.116921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9182e7b1-828b-4441-9e58-290c28b7a790 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:17.117759 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9182e7b1-828b-4441-9e58-290c28b7a790 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:17.132604 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9182e7b1-828b-4441-9e58-290c28b7a790 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:17.133541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9182e7b1-828b-4441-9e58-290c28b7a790 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:17.517883 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9182e7b1-828b-4441-9e58-290c28b7a790 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:17.527259 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9182e7b1-828b-4441-9e58-290c28b7a790 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.440981 Feb 21 02:29:17.529730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 165/315] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:17 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:17.793567 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ffa5a302-a959-42b3-a469-84f821bc0186 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:17.794461 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ffa5a302-a959-42b3-a469-84f821bc0186 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:17.849154 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ffa5a302-a959-42b3-a469-84f821bc0186 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:17.854407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ffa5a302-a959-42b3-a469-84f821bc0186 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:17.856852 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ffa5a302-a959-42b3-a469-84f821bc0186 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:17.858991 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ffa5a302-a959-42b3-a469-84f821bc0186 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:18.257831 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ffa5a302-a959-42b3-a469-84f821bc0186 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:18.278063 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ffa5a302-a959-42b3-a469-84f821bc0186 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.489250 Feb 21 02:29:18.289975 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 166/316] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:17 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:18.345044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:29:18.345580 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:29:18.345951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:29:18.346434 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:29:18.346844 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:29:18.369458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:18.370185 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:18.375659 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:18.377001 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:18.406784 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Getting quotas for project 440cb05903bb427baa54dbe25b56ee7c. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:29:18.415103 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Getting quotas for user 533f0f53f5504f0caec419a41f0f7452 and project 440cb05903bb427baa54dbe25b56ee7c. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:29:18.437578 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:29:18.440791 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:29:18.537944 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-cf132c70-cdeb-4d57-8935-ad715d4afd2f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.030676 Feb 21 02:29:18.540704 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 151/317] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:29:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 02:29:18.549443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ae21fe8e-d48f-4cc7-803f-b37a57fbde44 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:18.550418 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ae21fe8e-d48f-4cc7-803f-b37a57fbde44 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:18.561974 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae21fe8e-d48f-4cc7-803f-b37a57fbde44 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:18.562417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae21fe8e-d48f-4cc7-803f-b37a57fbde44 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:18.565699 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae21fe8e-d48f-4cc7-803f-b37a57fbde44 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:18.567243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-610a93ff-3bad-4b31-ac2b-9937bbe2b43a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:18.567684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae21fe8e-d48f-4cc7-803f-b37a57fbde44 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:18.571901 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-610a93ff-3bad-4b31-ac2b-9937bbe2b43a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:18.875155 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-610a93ff-3bad-4b31-ac2b-9937bbe2b43a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:18.884139 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-610a93ff-3bad-4b31-ac2b-9937bbe2b43a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1218 microversion: 2.1 time: 0.328850 Feb 21 02:29:18.886637 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 152/318] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:18 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1218 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:18.948946 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ae21fe8e-d48f-4cc7-803f-b37a57fbde44 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:18.958225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ae21fe8e-d48f-4cc7-803f-b37a57fbde44 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.412904 Feb 21 02:29:18.969823 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 167/319] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:18 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:19.296735 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-37fb61a9-74fb-4751-aff6-fe3159794f6d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:19.297343 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-37fb61a9-74fb-4751-aff6-fe3159794f6d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:19.307975 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37fb61a9-74fb-4751-aff6-fe3159794f6d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:19.308866 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37fb61a9-74fb-4751-aff6-fe3159794f6d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:19.309868 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37fb61a9-74fb-4751-aff6-fe3159794f6d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:19.310308 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37fb61a9-74fb-4751-aff6-fe3159794f6d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:19.654712 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-37fb61a9-74fb-4751-aff6-fe3159794f6d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:19.679143 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-37fb61a9-74fb-4751-aff6-fe3159794f6d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.383984 Feb 21 02:29:19.682741 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 153/320] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:19 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:19.903148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f4af567d-d58d-48f6-af7e-e41e045b3a64 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:19.903758 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f4af567d-d58d-48f6-af7e-e41e045b3a64 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:19.919993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f4af567d-d58d-48f6-af7e-e41e045b3a64 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:19.921144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f4af567d-d58d-48f6-af7e-e41e045b3a64 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:19.922692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f4af567d-d58d-48f6-af7e-e41e045b3a64 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:19.923704 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f4af567d-d58d-48f6-af7e-e41e045b3a64 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:19.983361 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-06eaf3a0-39b5-4b2e-b4d3-2a232badbe60 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:19.984100 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-06eaf3a0-39b5-4b2e-b4d3-2a232badbe60 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:20.002453 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-06eaf3a0-39b5-4b2e-b4d3-2a232badbe60 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:20.002934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-06eaf3a0-39b5-4b2e-b4d3-2a232badbe60 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:20.004244 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-06eaf3a0-39b5-4b2e-b4d3-2a232badbe60 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:20.004906 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-06eaf3a0-39b5-4b2e-b4d3-2a232badbe60 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:20.008764 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f4af567d-d58d-48f6-af7e-e41e045b3a64 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:20.017770 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f4af567d-d58d-48f6-af7e-e41e045b3a64 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1270 microversion: 2.1 time: 0.118093 Feb 21 02:29:20.020320 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 168/321] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:19 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:20.699778 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-23c692b7-f141-407d-a395-85ba12b93be7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:20.700708 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-23c692b7-f141-407d-a395-85ba12b93be7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:20.710748 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-23c692b7-f141-407d-a395-85ba12b93be7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:20.712342 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-23c692b7-f141-407d-a395-85ba12b93be7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:20.715735 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-23c692b7-f141-407d-a395-85ba12b93be7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:20.716738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-23c692b7-f141-407d-a395-85ba12b93be7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:20.959607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-06eaf3a0-39b5-4b2e-b4d3-2a232badbe60 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:20.970635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-06eaf3a0-39b5-4b2e-b4d3-2a232badbe60 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.991191 Feb 21 02:29:20.978922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 154/322] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:19 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:21.033959 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-23c692b7-f141-407d-a395-85ba12b93be7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:21.037331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-62d63f47-f8f5-4c91-a3cc-7eb6f8fdc031 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:21.038057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-62d63f47-f8f5-4c91-a3cc-7eb6f8fdc031 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:21.049103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-23c692b7-f141-407d-a395-85ba12b93be7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.353553 Feb 21 02:29:21.049936 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 169/323] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:20 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:21.053373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62d63f47-f8f5-4c91-a3cc-7eb6f8fdc031 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:21.053754 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62d63f47-f8f5-4c91-a3cc-7eb6f8fdc031 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:21.054822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62d63f47-f8f5-4c91-a3cc-7eb6f8fdc031 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:21.055172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62d63f47-f8f5-4c91-a3cc-7eb6f8fdc031 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:21.161956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-62d63f47-f8f5-4c91-a3cc-7eb6f8fdc031 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:21.170924 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-62d63f47-f8f5-4c91-a3cc-7eb6f8fdc031 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1276 microversion: 2.1 time: 0.137651 Feb 21 02:29:21.177822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 155/324] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:21 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:21.999514 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-db27f7d5-dc23-4989-8943-5ad3e06df2a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:22.000258 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-db27f7d5-dc23-4989-8943-5ad3e06df2a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:22.007970 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db27f7d5-dc23-4989-8943-5ad3e06df2a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:22.008411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db27f7d5-dc23-4989-8943-5ad3e06df2a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:22.009461 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db27f7d5-dc23-4989-8943-5ad3e06df2a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:22.009915 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db27f7d5-dc23-4989-8943-5ad3e06df2a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:22.065598 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6e3d941c-aca1-4870-b5ae-c21fdc9318d0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:22.067030 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6e3d941c-aca1-4870-b5ae-c21fdc9318d0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:22.074428 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6e3d941c-aca1-4870-b5ae-c21fdc9318d0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:22.074931 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6e3d941c-aca1-4870-b5ae-c21fdc9318d0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:22.075907 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6e3d941c-aca1-4870-b5ae-c21fdc9318d0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:22.076352 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6e3d941c-aca1-4870-b5ae-c21fdc9318d0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:22.170134 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-db27f7d5-dc23-4989-8943-5ad3e06df2a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:22.177962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-db27f7d5-dc23-4989-8943-5ad3e06df2a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.185453 Feb 21 02:29:22.178723 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 170/325] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:21 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:22.194356 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f013311a-ef68-4283-a64b-82773e696b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:22.195016 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f013311a-ef68-4283-a64b-82773e696b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:22.201417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f013311a-ef68-4283-a64b-82773e696b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:22.201898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f013311a-ef68-4283-a64b-82773e696b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:22.202701 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f013311a-ef68-4283-a64b-82773e696b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:22.203129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f013311a-ef68-4283-a64b-82773e696b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:22.298640 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6e3d941c-aca1-4870-b5ae-c21fdc9318d0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:22.307728 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6e3d941c-aca1-4870-b5ae-c21fdc9318d0 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.245728 Feb 21 02:29:22.309227 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 156/326] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:22 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:22.373252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f013311a-ef68-4283-a64b-82773e696b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:22.382422 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f013311a-ef68-4283-a64b-82773e696b18 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.192008 Feb 21 02:29:22.383068 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 171/327] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:22 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:22.518668 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-1ac3d826-c802-4079-9eb4-3ec3ee7a828e req-cd91cb03-0f35-488e-a49c-7daa551f033b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291df513-4591-43c9-89d7-f9974ba6f5c2", "tag": "859d3f05-bcb1-4fc1-b70f-b6eb03a8cb84"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:22.521085 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:29:22.521085 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:29:22.529134 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-1ac3d826-c802-4079-9eb4-3ec3ee7a828e req-cd91cb03-0f35-488e-a49c-7daa551f033b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:22.529815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-1ac3d826-c802-4079-9eb4-3ec3ee7a828e req-cd91cb03-0f35-488e-a49c-7daa551f033b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:22.541705 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-1ac3d826-c802-4079-9eb4-3ec3ee7a828e req-cd91cb03-0f35-488e-a49c-7daa551f033b service nova] Creating event network-changed:859d3f05-bcb1-4fc1-b70f-b6eb03a8cb84 for instance 291df513-4591-43c9-89d7-f9974ba6f5c2 on hv-cinder-80447 Feb 21 02:29:22.552578 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-1ac3d826-c802-4079-9eb4-3ec3ee7a828e req-cd91cb03-0f35-488e-a49c-7daa551f033b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031343 Feb 21 02:29:22.553264 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 157/328] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:23.196189 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-19830764-e289-426e-9ea1-3427eec5e338 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:23.196801 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-19830764-e289-426e-9ea1-3427eec5e338 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:23.203884 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-19830764-e289-426e-9ea1-3427eec5e338 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:23.204639 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-19830764-e289-426e-9ea1-3427eec5e338 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:23.205659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-19830764-e289-426e-9ea1-3427eec5e338 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:23.206330 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-19830764-e289-426e-9ea1-3427eec5e338 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:23.327771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9e6ae59c-8654-4c1d-b5ea-63fcfdd61e50 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:23.329015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9e6ae59c-8654-4c1d-b5ea-63fcfdd61e50 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:23.347992 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e6ae59c-8654-4c1d-b5ea-63fcfdd61e50 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:23.348703 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e6ae59c-8654-4c1d-b5ea-63fcfdd61e50 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:23.350005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e6ae59c-8654-4c1d-b5ea-63fcfdd61e50 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:23.350751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e6ae59c-8654-4c1d-b5ea-63fcfdd61e50 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:23.401964 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-19830764-e289-426e-9ea1-3427eec5e338 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:23.410212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-19830764-e289-426e-9ea1-3427eec5e338 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.217905 Feb 21 02:29:23.411023 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 172/329] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:23 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:23.417613 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fcd2a9a5-963e-4711-a909-64269f26fb9c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:23.418442 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fcd2a9a5-963e-4711-a909-64269f26fb9c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:23.425217 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fcd2a9a5-963e-4711-a909-64269f26fb9c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:23.426423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fcd2a9a5-963e-4711-a909-64269f26fb9c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:23.427276 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fcd2a9a5-963e-4711-a909-64269f26fb9c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:23.427737 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fcd2a9a5-963e-4711-a909-64269f26fb9c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:23.585505 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fcd2a9a5-963e-4711-a909-64269f26fb9c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:23.593192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fcd2a9a5-963e-4711-a909-64269f26fb9c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.180491 Feb 21 02:29:23.593801 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 173/330] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:23 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:23.684151 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9e6ae59c-8654-4c1d-b5ea-63fcfdd61e50 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:23.692061 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9e6ae59c-8654-4c1d-b5ea-63fcfdd61e50 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.369231 Feb 21 02:29:23.692802 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 158/331] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:23 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:24.441464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4c07ed18-1935-4f84-92c3-41b4c1fdc4d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:24.442199 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4c07ed18-1935-4f84-92c3-41b4c1fdc4d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:24.454171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4c07ed18-1935-4f84-92c3-41b4c1fdc4d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:24.456581 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4c07ed18-1935-4f84-92c3-41b4c1fdc4d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:24.459087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4c07ed18-1935-4f84-92c3-41b4c1fdc4d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:24.460518 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4c07ed18-1935-4f84-92c3-41b4c1fdc4d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:24.627636 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-82c32f76-8bb7-404f-a9fe-0053a939be6a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:24.628263 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-82c32f76-8bb7-404f-a9fe-0053a939be6a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:24.683444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-82c32f76-8bb7-404f-a9fe-0053a939be6a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:24.683929 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-82c32f76-8bb7-404f-a9fe-0053a939be6a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:24.684887 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-82c32f76-8bb7-404f-a9fe-0053a939be6a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:24.685192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-82c32f76-8bb7-404f-a9fe-0053a939be6a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:24.700733 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4c07ed18-1935-4f84-92c3-41b4c1fdc4d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:24.712955 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4c07ed18-1935-4f84-92c3-41b4c1fdc4d0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.288979 Feb 21 02:29:24.714030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 174/332] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:24 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:24.719137 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-e0d64940-cfab-49d9-af99-f9a5ddb2adc5 req-221d51d5-c925-40e2-9496-a26c15f488f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813e8757-d323-4bbc-89e9-d7a687663a8f", "name": "network-vif-plugged", "status": "completed", "tag": "13e94cd1-063a-4c40-9c82-feb80fe73d30"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:24.721080 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:29:24.721080 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:29:24.737017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-e0d64940-cfab-49d9-af99-f9a5ddb2adc5 req-221d51d5-c925-40e2-9496-a26c15f488f6 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:24.738132 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-e0d64940-cfab-49d9-af99-f9a5ddb2adc5 req-221d51d5-c925-40e2-9496-a26c15f488f6 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:24.758118 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-e0d64940-cfab-49d9-af99-f9a5ddb2adc5 req-221d51d5-c925-40e2-9496-a26c15f488f6 service nova] Creating event network-vif-plugged:13e94cd1-063a-4c40-9c82-feb80fe73d30 for instance 813e8757-d323-4bbc-89e9-d7a687663a8f on hv-cinder-80447 Feb 21 02:29:24.767436 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-e0d64940-cfab-49d9-af99-f9a5ddb2adc5 req-221d51d5-c925-40e2-9496-a26c15f488f6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050874 Feb 21 02:29:24.777781 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 175/333] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:24.806260 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-18fdc40a-b48e-41ce-986f-dd45c98929f4 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:24.807956 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-18fdc40a-b48e-41ce-986f-dd45c98929f4 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:24.822501 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-18fdc40a-b48e-41ce-986f-dd45c98929f4 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:24.823137 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-18fdc40a-b48e-41ce-986f-dd45c98929f4 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:24.824242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-18fdc40a-b48e-41ce-986f-dd45c98929f4 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:24.825231 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-18fdc40a-b48e-41ce-986f-dd45c98929f4 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:24.938129 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-82c32f76-8bb7-404f-a9fe-0053a939be6a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:24.950825 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-82c32f76-8bb7-404f-a9fe-0053a939be6a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.344136 Feb 21 02:29:24.951503 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 159/334] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:24 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:25.010479 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-18fdc40a-b48e-41ce-986f-dd45c98929f4 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:25.018579 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-18fdc40a-b48e-41ce-986f-dd45c98929f4 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.239153 Feb 21 02:29:25.029126 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 176/335] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:24 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:25.743535 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-31e5d29f-9d00-4128-a75d-309e5f3ec643 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:25.744877 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-31e5d29f-9d00-4128-a75d-309e5f3ec643 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:25.752435 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-31e5d29f-9d00-4128-a75d-309e5f3ec643 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:25.753270 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-31e5d29f-9d00-4128-a75d-309e5f3ec643 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:25.754287 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-31e5d29f-9d00-4128-a75d-309e5f3ec643 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:25.754867 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-31e5d29f-9d00-4128-a75d-309e5f3ec643 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:25.970210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d793b107-af28-486e-a9e1-eb4c170dfb38 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:25.971844 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d793b107-af28-486e-a9e1-eb4c170dfb38 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:25.989201 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d793b107-af28-486e-a9e1-eb4c170dfb38 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:25.989687 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d793b107-af28-486e-a9e1-eb4c170dfb38 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:25.991365 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d793b107-af28-486e-a9e1-eb4c170dfb38 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:25.993787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d793b107-af28-486e-a9e1-eb4c170dfb38 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:26.060633 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-31e5d29f-9d00-4128-a75d-309e5f3ec643 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:26.071022 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-31e5d29f-9d00-4128-a75d-309e5f3ec643 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.343805 Feb 21 02:29:26.071956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 160/336] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:25 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:26.085913 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c6479269-a6e7-4b31-b4f2-9602de3f4665 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:26.086750 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c6479269-a6e7-4b31-b4f2-9602de3f4665 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:26.100649 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c6479269-a6e7-4b31-b4f2-9602de3f4665 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:26.101240 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c6479269-a6e7-4b31-b4f2-9602de3f4665 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:26.102195 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c6479269-a6e7-4b31-b4f2-9602de3f4665 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:26.102758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c6479269-a6e7-4b31-b4f2-9602de3f4665 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:26.257635 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d793b107-af28-486e-a9e1-eb4c170dfb38 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:26.267091 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d793b107-af28-486e-a9e1-eb4c170dfb38 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.302655 Feb 21 02:29:26.277966 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 177/337] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:25 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:26.483504 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c6479269-a6e7-4b31-b4f2-9602de3f4665 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:26.495926 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c6479269-a6e7-4b31-b4f2-9602de3f4665 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1314 microversion: 2.1 time: 0.422795 Feb 21 02:29:26.496662 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 161/338] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:26 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:27.092546 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-094922bc-39e9-4b93-af6b-e2d352874659 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:27.094387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-094922bc-39e9-4b93-af6b-e2d352874659 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:27.111465 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-094922bc-39e9-4b93-af6b-e2d352874659 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:27.112531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-094922bc-39e9-4b93-af6b-e2d352874659 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:27.114432 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-094922bc-39e9-4b93-af6b-e2d352874659 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:27.119114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-094922bc-39e9-4b93-af6b-e2d352874659 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:27.288042 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e2933c46-07b2-429d-a319-1794a9003fee tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:27.288890 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e2933c46-07b2-429d-a319-1794a9003fee tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:27.304129 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2933c46-07b2-429d-a319-1794a9003fee tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:27.305885 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2933c46-07b2-429d-a319-1794a9003fee tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:27.309349 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2933c46-07b2-429d-a319-1794a9003fee tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:27.312463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2933c46-07b2-429d-a319-1794a9003fee tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:27.379922 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-094922bc-39e9-4b93-af6b-e2d352874659 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:27.390535 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-094922bc-39e9-4b93-af6b-e2d352874659 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.305715 Feb 21 02:29:27.391178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 178/339] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:27 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:27.512083 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b26dd405-e3e0-416d-9fcb-628061184e1d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:27.512684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b26dd405-e3e0-416d-9fcb-628061184e1d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:27.521695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b26dd405-e3e0-416d-9fcb-628061184e1d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:27.522401 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b26dd405-e3e0-416d-9fcb-628061184e1d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:27.523458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b26dd405-e3e0-416d-9fcb-628061184e1d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:27.523885 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b26dd405-e3e0-416d-9fcb-628061184e1d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:27.713687 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b26dd405-e3e0-416d-9fcb-628061184e1d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:27.719962 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e2933c46-07b2-429d-a319-1794a9003fee tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:27.727982 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b26dd405-e3e0-416d-9fcb-628061184e1d tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1498 microversion: 2.1 time: 0.218757 Feb 21 02:29:27.731773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e2933c46-07b2-429d-a319-1794a9003fee tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.450726 Feb 21 02:29:27.732974 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 162/340] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:27 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:27.747048 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 179/341] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:27 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1498 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:28.423544 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f14747b2-02c9-4c52-837b-ee51d4b94900 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:28.424931 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f14747b2-02c9-4c52-837b-ee51d4b94900 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:28.438233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f14747b2-02c9-4c52-837b-ee51d4b94900 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:28.438882 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f14747b2-02c9-4c52-837b-ee51d4b94900 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:28.439829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f14747b2-02c9-4c52-837b-ee51d4b94900 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:28.440408 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f14747b2-02c9-4c52-837b-ee51d4b94900 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:28.695046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4e297472-09c8-4cbf-afd2-9790248b970a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:28.695726 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4e297472-09c8-4cbf-afd2-9790248b970a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:28.703239 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4e297472-09c8-4cbf-afd2-9790248b970a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:28.705055 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4e297472-09c8-4cbf-afd2-9790248b970a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:28.706196 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4e297472-09c8-4cbf-afd2-9790248b970a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:28.706875 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4e297472-09c8-4cbf-afd2-9790248b970a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:28.735221 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f14747b2-02c9-4c52-837b-ee51d4b94900 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:28.743910 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f14747b2-02c9-4c52-837b-ee51d4b94900 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.335999 Feb 21 02:29:28.747914 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 163/342] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:28 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:28.770469 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-224e5bc4-7539-4bd0-9aee-365f35b07f70 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:28.771210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-224e5bc4-7539-4bd0-9aee-365f35b07f70 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:28.798788 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-224e5bc4-7539-4bd0-9aee-365f35b07f70 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:28.799315 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-224e5bc4-7539-4bd0-9aee-365f35b07f70 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:28.800960 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-224e5bc4-7539-4bd0-9aee-365f35b07f70 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:28.803692 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-224e5bc4-7539-4bd0-9aee-365f35b07f70 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:28.808751 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4e297472-09c8-4cbf-afd2-9790248b970a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:29:29.051354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4e297472-09c8-4cbf-afd2-9790248b970a tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "DELETE /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 204 len: 0 microversion: 2.1 time: 0.361202 Feb 21 02:29:29.057627 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 180/343] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:29:28 2022] DELETE /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 02:29:29.071976 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0561bf42-3d13-4780-a9cc-995f8bc5558e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:29.072823 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0561bf42-3d13-4780-a9cc-995f8bc5558e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:29.080523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0561bf42-3d13-4780-a9cc-995f8bc5558e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:29.081262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0561bf42-3d13-4780-a9cc-995f8bc5558e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:29.082836 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0561bf42-3d13-4780-a9cc-995f8bc5558e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:29.083282 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0561bf42-3d13-4780-a9cc-995f8bc5558e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:29.189926 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-224e5bc4-7539-4bd0-9aee-365f35b07f70 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:29.202436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-224e5bc4-7539-4bd0-9aee-365f35b07f70 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.452544 Feb 21 02:29:29.204518 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 164/344] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:28 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:29.336890 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0561bf42-3d13-4780-a9cc-995f8bc5558e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:29.344290 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0561bf42-3d13-4780-a9cc-995f8bc5558e tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1504 microversion: 2.1 time: 0.285293 Feb 21 02:29:29.346304 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 181/345] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:29 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:29.764150 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bb289ea9-c190-4d9a-be99-8a3b2ab1de0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:29.764767 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bb289ea9-c190-4d9a-be99-8a3b2ab1de0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:29.771499 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bb289ea9-c190-4d9a-be99-8a3b2ab1de0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:29.771949 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bb289ea9-c190-4d9a-be99-8a3b2ab1de0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:29.772756 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bb289ea9-c190-4d9a-be99-8a3b2ab1de0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:29.773179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bb289ea9-c190-4d9a-be99-8a3b2ab1de0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:30.053870 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bb289ea9-c190-4d9a-be99-8a3b2ab1de0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:30.061942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bb289ea9-c190-4d9a-be99-8a3b2ab1de0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.301221 Feb 21 02:29:30.072266 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 165/346] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:29 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:30.224357 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-99bc9064-038f-42cb-ae1b-e491581167da tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:30.225622 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-99bc9064-038f-42cb-ae1b-e491581167da tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:30.231953 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99bc9064-038f-42cb-ae1b-e491581167da tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:30.232404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99bc9064-038f-42cb-ae1b-e491581167da tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:30.233218 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99bc9064-038f-42cb-ae1b-e491581167da tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:30.233850 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99bc9064-038f-42cb-ae1b-e491581167da tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:30.373602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2e2334c4-09ca-4577-af90-71ce82cc1fd7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:30.374533 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2e2334c4-09ca-4577-af90-71ce82cc1fd7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:30.382170 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2e2334c4-09ca-4577-af90-71ce82cc1fd7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:30.382633 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2e2334c4-09ca-4577-af90-71ce82cc1fd7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:30.383427 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2e2334c4-09ca-4577-af90-71ce82cc1fd7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:30.384136 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2e2334c4-09ca-4577-af90-71ce82cc1fd7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:30.576485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-99bc9064-038f-42cb-ae1b-e491581167da tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:30.587621 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-99bc9064-038f-42cb-ae1b-e491581167da tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.369729 Feb 21 02:29:30.597795 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 182/347] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:30 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:30.709196 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2e2334c4-09ca-4577-af90-71ce82cc1fd7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:30.717096 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2e2334c4-09ca-4577-af90-71ce82cc1fd7 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1504 microversion: 2.1 time: 0.358698 Feb 21 02:29:30.717724 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 166/348] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:30 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:31.079283 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c9018472-4482-4a72-8936-05a0f79f7b6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:31.079909 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c9018472-4482-4a72-8936-05a0f79f7b6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:31.087390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c9018472-4482-4a72-8936-05a0f79f7b6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:31.087939 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c9018472-4482-4a72-8936-05a0f79f7b6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:31.089259 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c9018472-4482-4a72-8936-05a0f79f7b6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:31.089893 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c9018472-4482-4a72-8936-05a0f79f7b6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:31.287744 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c9018472-4482-4a72-8936-05a0f79f7b6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:31.299161 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c9018472-4482-4a72-8936-05a0f79f7b6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.223258 Feb 21 02:29:31.305952 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 183/349] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:31 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:31.606550 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b89bdec4-35e8-4b98-85c1-4ca2a2ffa85f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:31.607784 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b89bdec4-35e8-4b98-85c1-4ca2a2ffa85f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:31.618231 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b89bdec4-35e8-4b98-85c1-4ca2a2ffa85f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:31.619204 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b89bdec4-35e8-4b98-85c1-4ca2a2ffa85f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:31.620049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b89bdec4-35e8-4b98-85c1-4ca2a2ffa85f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:31.620433 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b89bdec4-35e8-4b98-85c1-4ca2a2ffa85f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:31.737742 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-374f44fe-4b8a-49a2-8757-84f9b68191e5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:31.739013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-374f44fe-4b8a-49a2-8757-84f9b68191e5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:31.755022 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-374f44fe-4b8a-49a2-8757-84f9b68191e5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:31.758467 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-374f44fe-4b8a-49a2-8757-84f9b68191e5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:31.766331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-374f44fe-4b8a-49a2-8757-84f9b68191e5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:31.770470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-374f44fe-4b8a-49a2-8757-84f9b68191e5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:31.980216 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b89bdec4-35e8-4b98-85c1-4ca2a2ffa85f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:31.991867 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b89bdec4-35e8-4b98-85c1-4ca2a2ffa85f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.391309 Feb 21 02:29:31.992455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 167/350] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:31 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:32.073932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-374f44fe-4b8a-49a2-8757-84f9b68191e5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:32.087653 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-374f44fe-4b8a-49a2-8757-84f9b68191e5 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1504 microversion: 2.1 time: 0.355396 Feb 21 02:29:32.088234 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 184/351] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:31 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:32.323858 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a62ce2c2-4b60-42ae-b869-51581c0335d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:32.327891 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a62ce2c2-4b60-42ae-b869-51581c0335d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:32.357289 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a62ce2c2-4b60-42ae-b869-51581c0335d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:32.359956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a62ce2c2-4b60-42ae-b869-51581c0335d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:32.363654 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a62ce2c2-4b60-42ae-b869-51581c0335d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:32.365899 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a62ce2c2-4b60-42ae-b869-51581c0335d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:32.371406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-cc2c4d1f-8906-43b0-bb39-972d13ae1d4a req-81624899-37f1-446c-8ab9-319b373f527c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813e8757-d323-4bbc-89e9-d7a687663a8f", "name": "network-vif-deleted", "tag": "13e94cd1-063a-4c40-9c82-feb80fe73d30"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:32.374064 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:29:32.374064 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:29:32.389074 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-cc2c4d1f-8906-43b0-bb39-972d13ae1d4a req-81624899-37f1-446c-8ab9-319b373f527c service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:32.389615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-cc2c4d1f-8906-43b0-bb39-972d13ae1d4a req-81624899-37f1-446c-8ab9-319b373f527c service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:32.421926 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-cc2c4d1f-8906-43b0-bb39-972d13ae1d4a req-81624899-37f1-446c-8ab9-319b373f527c service nova] Creating event network-vif-deleted:13e94cd1-063a-4c40-9c82-feb80fe73d30 for instance 813e8757-d323-4bbc-89e9-d7a687663a8f on hv-cinder-80447 Feb 21 02:29:32.433820 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-cc2c4d1f-8906-43b0-bb39-972d13ae1d4a req-81624899-37f1-446c-8ab9-319b373f527c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071341 Feb 21 02:29:32.448304 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 185/352] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Feb 21 02:29:32.740278 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a62ce2c2-4b60-42ae-b869-51581c0335d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:32.749886 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a62ce2c2-4b60-42ae-b869-51581c0335d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.437772 Feb 21 02:29:32.760116 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 168/353] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:32 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:33.013944 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-db7ba1c1-a6ed-4817-b28d-1c6bae791d9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:33.016368 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-db7ba1c1-a6ed-4817-b28d-1c6bae791d9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:33.025468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db7ba1c1-a6ed-4817-b28d-1c6bae791d9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:33.025951 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db7ba1c1-a6ed-4817-b28d-1c6bae791d9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:33.026921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db7ba1c1-a6ed-4817-b28d-1c6bae791d9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:33.027359 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db7ba1c1-a6ed-4817-b28d-1c6bae791d9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:33.105497 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:33.106246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:33.114090 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:33.114789 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:33.115757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:33.116350 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:33.152049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:33.152933 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:33.153617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lazy-loading 'fault' on Instance uuid 813e8757-d323-4bbc-89e9-d7a687663a8f {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:29:33.242520 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc9cadc548ce4093a9e1f749e5e7375c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe91b074cd3444ea5b8e2a29179016d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:33.259530 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d06b9cb1-b84c-448e-a946-6912083afe31 tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 200 len: 1304 microversion: 2.1 time: 0.157618 Feb 21 02:29:33.261626 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 169/354] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:33 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:33.543041 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-325d752c-368f-4077-9465-a7cfa76e1b6d req-21332ad9-2d17-4097-9357-f5a8f72cc8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291df513-4591-43c9-89d7-f9974ba6f5c2", "name": "network-vif-plugged", "status": "completed", "tag": "859d3f05-bcb1-4fc1-b70f-b6eb03a8cb84"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:33.547432 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:29:33.547432 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:29:33.561083 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-db7ba1c1-a6ed-4817-b28d-1c6bae791d9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:33.575292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-db7ba1c1-a6ed-4817-b28d-1c6bae791d9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.569220 Feb 21 02:29:33.577454 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-325d752c-368f-4077-9465-a7cfa76e1b6d req-21332ad9-2d17-4097-9357-f5a8f72cc8a2 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:33.578605 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-325d752c-368f-4077-9465-a7cfa76e1b6d req-21332ad9-2d17-4097-9357-f5a8f72cc8a2 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:33.579734 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 186/355] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:33 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:33.610653 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-325d752c-368f-4077-9465-a7cfa76e1b6d req-21332ad9-2d17-4097-9357-f5a8f72cc8a2 service nova] Creating event network-vif-plugged:859d3f05-bcb1-4fc1-b70f-b6eb03a8cb84 for instance 291df513-4591-43c9-89d7-f9974ba6f5c2 on hv-cinder-80447 Feb 21 02:29:33.616497 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-325d752c-368f-4077-9465-a7cfa76e1b6d req-21332ad9-2d17-4097-9357-f5a8f72cc8a2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085344 Feb 21 02:29:33.617743 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 170/356] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:29:33.768024 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f040a838-6d2b-40b5-bebe-b47b1b11abac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:33.775365 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f040a838-6d2b-40b5-bebe-b47b1b11abac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:33.791319 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f040a838-6d2b-40b5-bebe-b47b1b11abac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:33.791789 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f040a838-6d2b-40b5-bebe-b47b1b11abac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:33.792366 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f040a838-6d2b-40b5-bebe-b47b1b11abac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:33.792810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f040a838-6d2b-40b5-bebe-b47b1b11abac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:34.111628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f040a838-6d2b-40b5-bebe-b47b1b11abac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:34.123094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f040a838-6d2b-40b5-bebe-b47b1b11abac tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.359271 Feb 21 02:29:34.123792 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 187/357] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:33 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:34.279171 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:34.280003 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] [instance: 813e8757-d323-4bbc-89e9-d7a687663a8f] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:34.291800 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:34.292649 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:34.293684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:34.294328 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:34.312642 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] HTTP exception thrown: Instance 813e8757-d323-4bbc-89e9-d7a687663a8f could not be found. Feb 21 02:29:34.313670 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] Returning 404 to user: Instance 813e8757-d323-4bbc-89e9-d7a687663a8f could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:29:34.314734 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3e165bff-4028-48cf-a845-d3239c242fca tempest-VolumesActionsTest-276418170 tempest-VolumesActionsTest-276418170-project] 10.222.0.75 "GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f" status: 404 len: 111 microversion: 2.1 time: 0.039994 Feb 21 02:29:34.322968 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 171/358] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:34 2022] GET /compute/v2.1/servers/813e8757-d323-4bbc-89e9-d7a687663a8f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:29:34.607331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-61da9ac0-3db0-4226-803a-7cb4ef59e9c0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:34.614038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-61da9ac0-3db0-4226-803a-7cb4ef59e9c0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:34.631633 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-61da9ac0-3db0-4226-803a-7cb4ef59e9c0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:34.633317 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-61da9ac0-3db0-4226-803a-7cb4ef59e9c0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:34.635892 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-61da9ac0-3db0-4226-803a-7cb4ef59e9c0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:34.636991 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-61da9ac0-3db0-4226-803a-7cb4ef59e9c0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:35.100082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-61da9ac0-3db0-4226-803a-7cb4ef59e9c0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:35.112782 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-61da9ac0-3db0-4226-803a-7cb4ef59e9c0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1318 microversion: 2.1 time: 0.510539 Feb 21 02:29:35.115470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 188/359] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:34 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:35.140666 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-12751be4-54e2-4917-b070-e15c0a23d329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:35.141514 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-12751be4-54e2-4917-b070-e15c0a23d329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:35.148613 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-12751be4-54e2-4917-b070-e15c0a23d329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:35.149375 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-12751be4-54e2-4917-b070-e15c0a23d329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:35.150413 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-12751be4-54e2-4917-b070-e15c0a23d329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:35.151155 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-12751be4-54e2-4917-b070-e15c0a23d329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:35.596352 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-12751be4-54e2-4917-b070-e15c0a23d329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:35.605127 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-12751be4-54e2-4917-b070-e15c0a23d329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1501 microversion: 2.1 time: 0.468599 Feb 21 02:29:35.606409 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 172/360] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:35 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1501 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:35.627359 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3feb065e-4d11-4c48-90a3-847b675925b5"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:35.629852 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:35.638898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:35.639580 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:35.640567 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:35.641160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:35.673293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] HTTP exception thrown: Cannot 'attach_volume' instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 while it is in vm_state rescued Feb 21 02:29:35.674424 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Returning 409 to user: Cannot 'attach_volume' instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 while it is in vm_state rescued {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:29:35.676390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-49181ff4-a8c6-4408-ab06-553490688de0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053845 Feb 21 02:29:35.677451 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 189/361] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:29:35 2022] POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 21 02:29:35.688173 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e87f7187-56b9-4618-ab92-82a7690cc7b2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:35.689065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e87f7187-56b9-4618-ab92-82a7690cc7b2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:35.698035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e87f7187-56b9-4618-ab92-82a7690cc7b2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:35.698844 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e87f7187-56b9-4618-ab92-82a7690cc7b2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:35.705166 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e87f7187-56b9-4618-ab92-82a7690cc7b2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:35.705662 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e87f7187-56b9-4618-ab92-82a7690cc7b2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:35.859730 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e87f7187-56b9-4618-ab92-82a7690cc7b2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/action" status: 202 len: 0 microversion: 2.1 time: 0.177214 Feb 21 02:29:35.876416 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 173/362] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:29:35 2022] POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:29:35.887785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fc28a177-4a2a-4968-a2df-8d48cc97caf6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:35.888417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fc28a177-4a2a-4968-a2df-8d48cc97caf6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:35.906590 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fc28a177-4a2a-4968-a2df-8d48cc97caf6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:35.907162 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fc28a177-4a2a-4968-a2df-8d48cc97caf6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:35.912729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fc28a177-4a2a-4968-a2df-8d48cc97caf6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:35.913281 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fc28a177-4a2a-4968-a2df-8d48cc97caf6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:36.136015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4d7bd2eb-747f-4560-8c26-f5cd89fa0bda tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:36.136725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4d7bd2eb-747f-4560-8c26-f5cd89fa0bda tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:36.173021 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4d7bd2eb-747f-4560-8c26-f5cd89fa0bda tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:36.173471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4d7bd2eb-747f-4560-8c26-f5cd89fa0bda tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:36.176905 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4d7bd2eb-747f-4560-8c26-f5cd89fa0bda tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:36.177360 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4d7bd2eb-747f-4560-8c26-f5cd89fa0bda tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:36.253938 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fc28a177-4a2a-4968-a2df-8d48cc97caf6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:36.266052 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fc28a177-4a2a-4968-a2df-8d48cc97caf6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.381232 Feb 21 02:29:36.270395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 190/363] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:35 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:36.968549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4d7bd2eb-747f-4560-8c26-f5cd89fa0bda tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:36.978611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4d7bd2eb-747f-4560-8c26-f5cd89fa0bda tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1507 microversion: 2.1 time: 0.848132 Feb 21 02:29:36.980057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 174/364] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:36 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:37.287411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3ca2e376-6a5c-42b0-a24f-4775cbb2fd0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:37.288756 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3ca2e376-6a5c-42b0-a24f-4775cbb2fd0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:37.295755 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ca2e376-6a5c-42b0-a24f-4775cbb2fd0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:37.296271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ca2e376-6a5c-42b0-a24f-4775cbb2fd0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:37.297078 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ca2e376-6a5c-42b0-a24f-4775cbb2fd0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:37.297692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3ca2e376-6a5c-42b0-a24f-4775cbb2fd0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:37.695596 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3ca2e376-6a5c-42b0-a24f-4775cbb2fd0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:37.709255 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3ca2e376-6a5c-42b0-a24f-4775cbb2fd0f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.425571 Feb 21 02:29:37.710094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 191/365] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:37 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:38.620248 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6deb9174-c2fd-450a-b025-33ceb43a7a29 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Action: 'create', calling method: .version_select at 0x7fd85c203940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-72472954"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:38.633694 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-6deb9174-c2fd-450a-b025-33ceb43a7a29 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for project 9d0c19115c1746f1956552777cc35baf. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:29:38.637553 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-6deb9174-c2fd-450a-b025-33ceb43a7a29 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for user 9e81057507d24a2ca8f7b57eef422397 and project 9d0c19115c1746f1956552777cc35baf. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:29:38.727115 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f7c99af3-a366-49d4-ac39-da84ac465f27 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:38.728235 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f7c99af3-a366-49d4-ac39-da84ac465f27 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:38.735348 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7c99af3-a366-49d4-ac39-da84ac465f27 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:38.735794 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7c99af3-a366-49d4-ac39-da84ac465f27 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:38.736568 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7c99af3-a366-49d4-ac39-da84ac465f27 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:38.736997 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7c99af3-a366-49d4-ac39-da84ac465f27 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:38.846463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-6deb9174-c2fd-450a-b025-33ceb43a7a29 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for project 9d0c19115c1746f1956552777cc35baf. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:29:38.854550 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-6deb9174-c2fd-450a-b025-33ceb43a7a29 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for user 9e81057507d24a2ca8f7b57eef422397 and project 9d0c19115c1746f1956552777cc35baf. Resources: {'key_pairs'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:29:38.869720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6deb9174-c2fd-450a-b025-33ceb43a7a29 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.417070 Feb 21 02:29:38.870316 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 175/366] 10.222.0.75 () {60 vars in 1157 bytes} [Mon Feb 21 02:29:38 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:38.880531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f7c99af3-a366-49d4-ac39-da84ac465f27 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:38.893016 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f7c99af3-a366-49d4-ac39-da84ac465f27 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.169321 Feb 21 02:29:38.894568 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 192/367] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:38 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:29:39.912361 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8a7cf748-53f6-4e79-bb63-ced59d550822 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:39.913585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8a7cf748-53f6-4e79-bb63-ced59d550822 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:39.924337 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8a7cf748-53f6-4e79-bb63-ced59d550822 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:39.933762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8a7cf748-53f6-4e79-bb63-ced59d550822 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:39.936817 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8a7cf748-53f6-4e79-bb63-ced59d550822 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:39.938197 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8a7cf748-53f6-4e79-bb63-ced59d550822 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:40.150046 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8a7cf748-53f6-4e79-bb63-ced59d550822 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:40.159912 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8a7cf748-53f6-4e79-bb63-ced59d550822 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.251995 Feb 21 02:29:40.161728 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 176/368] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:39 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:41.178573 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e60ab6e5-5582-46fd-bff9-d4ea8fb00c62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:41.179894 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e60ab6e5-5582-46fd-bff9-d4ea8fb00c62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:41.186330 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e60ab6e5-5582-46fd-bff9-d4ea8fb00c62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:41.186783 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e60ab6e5-5582-46fd-bff9-d4ea8fb00c62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:41.187561 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e60ab6e5-5582-46fd-bff9-d4ea8fb00c62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:41.188035 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e60ab6e5-5582-46fd-bff9-d4ea8fb00c62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:41.340631 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e60ab6e5-5582-46fd-bff9-d4ea8fb00c62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:41.352379 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e60ab6e5-5582-46fd-bff9-d4ea8fb00c62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.177649 Feb 21 02:29:41.353685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 193/369] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:41 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:42.370355 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f41968c7-6cf4-4a7b-a4d6-42a51fd05c64 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:42.370956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f41968c7-6cf4-4a7b-a4d6-42a51fd05c64 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:42.377214 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f41968c7-6cf4-4a7b-a4d6-42a51fd05c64 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:42.377776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f41968c7-6cf4-4a7b-a4d6-42a51fd05c64 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:42.379093 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f41968c7-6cf4-4a7b-a4d6-42a51fd05c64 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:42.379519 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f41968c7-6cf4-4a7b-a4d6-42a51fd05c64 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:42.512973 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f41968c7-6cf4-4a7b-a4d6-42a51fd05c64 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:42.520368 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f41968c7-6cf4-4a7b-a4d6-42a51fd05c64 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.154572 Feb 21 02:29:42.520936 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 177/370] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:42 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:43.536999 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-60629930-771d-4dde-a316-33e2205ccaa6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:43.537526 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-60629930-771d-4dde-a316-33e2205ccaa6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:43.543833 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60629930-771d-4dde-a316-33e2205ccaa6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:43.544272 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60629930-771d-4dde-a316-33e2205ccaa6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:43.545047 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60629930-771d-4dde-a316-33e2205ccaa6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:43.545475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60629930-771d-4dde-a316-33e2205ccaa6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:43.677496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-60629930-771d-4dde-a316-33e2205ccaa6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:43.684683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-60629930-771d-4dde-a316-33e2205ccaa6 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.152324 Feb 21 02:29:43.685235 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 194/371] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:43 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:44.701391 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3f9c22ba-e582-4743-8b79-1e746a927902 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:44.702035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3f9c22ba-e582-4743-8b79-1e746a927902 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:44.708174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3f9c22ba-e582-4743-8b79-1e746a927902 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:44.708624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3f9c22ba-e582-4743-8b79-1e746a927902 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:44.709406 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3f9c22ba-e582-4743-8b79-1e746a927902 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:44.709871 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3f9c22ba-e582-4743-8b79-1e746a927902 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:44.881204 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3f9c22ba-e582-4743-8b79-1e746a927902 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:44.889281 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3f9c22ba-e582-4743-8b79-1e746a927902 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.191419 Feb 21 02:29:44.890414 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 178/372] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:44 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:45.912045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d6a31121-ef6b-49c7-acce-757a187f61fb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:45.913366 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d6a31121-ef6b-49c7-acce-757a187f61fb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:45.920138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6a31121-ef6b-49c7-acce-757a187f61fb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:45.920592 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6a31121-ef6b-49c7-acce-757a187f61fb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:45.921619 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6a31121-ef6b-49c7-acce-757a187f61fb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:45.922276 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6a31121-ef6b-49c7-acce-757a187f61fb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:45.989791 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-27ec5b6a-6079-4269-9776-13563acb6578 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90deda31-164f-4b61-b884-3598c3c3019e"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:45.991091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-27ec5b6a-6079-4269-9776-13563acb6578 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:46.008677 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27ec5b6a-6079-4269-9776-13563acb6578 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:46.009133 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27ec5b6a-6079-4269-9776-13563acb6578 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:46.009992 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27ec5b6a-6079-4269-9776-13563acb6578 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:46.010594 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27ec5b6a-6079-4269-9776-13563acb6578 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:46.130553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d6a31121-ef6b-49c7-acce-757a187f61fb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:46.138291 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d6a31121-ef6b-49c7-acce-757a187f61fb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.230294 Feb 21 02:29:46.139081 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 195/373] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:45 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:46.341900 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-27ec5b6a-6079-4269-9776-13563acb6578 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360430 Feb 21 02:29:46.342637 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 179/374] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:29:45 2022] POST /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:47.166276 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-bcceff0d-1145-428f-99a1-d9787b7f2eca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:47.166858 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-bcceff0d-1145-428f-99a1-d9787b7f2eca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:47.176594 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bcceff0d-1145-428f-99a1-d9787b7f2eca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:47.177032 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bcceff0d-1145-428f-99a1-d9787b7f2eca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:47.177832 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bcceff0d-1145-428f-99a1-d9787b7f2eca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:47.178261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bcceff0d-1145-428f-99a1-d9787b7f2eca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:47.317354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bcceff0d-1145-428f-99a1-d9787b7f2eca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:47.324721 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-bcceff0d-1145-428f-99a1-d9787b7f2eca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1509 microversion: 2.1 time: 0.163217 Feb 21 02:29:47.325292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 196/375] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:47 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:48.345235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3e6c2738-341c-4e0f-ac37-bc8959a72b5f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:48.345916 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3e6c2738-341c-4e0f-ac37-bc8959a72b5f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:48.354274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e6c2738-341c-4e0f-ac37-bc8959a72b5f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:48.354762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e6c2738-341c-4e0f-ac37-bc8959a72b5f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:48.355650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e6c2738-341c-4e0f-ac37-bc8959a72b5f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:48.356110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e6c2738-341c-4e0f-ac37-bc8959a72b5f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:48.508779 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3e6c2738-341c-4e0f-ac37-bc8959a72b5f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:48.530560 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3e6c2738-341c-4e0f-ac37-bc8959a72b5f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1515 microversion: 2.1 time: 0.189596 Feb 21 02:29:48.531625 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 180/376] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:48 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:49.900684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-81580438-c114-45a0-9105-46c84b0c3bb0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:49.901293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-81580438-c114-45a0-9105-46c84b0c3bb0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:49.907519 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-81580438-c114-45a0-9105-46c84b0c3bb0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:49.907971 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-81580438-c114-45a0-9105-46c84b0c3bb0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:49.908773 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-81580438-c114-45a0-9105-46c84b0c3bb0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:49.909849 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-81580438-c114-45a0-9105-46c84b0c3bb0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:50.054676 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-81580438-c114-45a0-9105-46c84b0c3bb0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:29:50.063030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-81580438-c114-45a0-9105-46c84b0c3bb0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1515 microversion: 2.1 time: 0.165983 Feb 21 02:29:50.063712 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 197/377] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:29:49 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:29:50.082025 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a90968d7-724d-4c36-8d1c-c8e19916fbfb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16188598-1cb3-44d5-af55-45037a4b7c74"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:50.083288 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a90968d7-724d-4c36-8d1c-c8e19916fbfb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:50.089583 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a90968d7-724d-4c36-8d1c-c8e19916fbfb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:50.090055 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a90968d7-724d-4c36-8d1c-c8e19916fbfb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:50.090830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a90968d7-724d-4c36-8d1c-c8e19916fbfb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:50.091260 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a90968d7-724d-4c36-8d1c-c8e19916fbfb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:50.384062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a90968d7-724d-4c36-8d1c-c8e19916fbfb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306312 Feb 21 02:29:50.392933 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 181/378] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:29:50 2022] POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:53.979067 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90deda31-164f-4b61-b884-3598c3c3019e"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:53.980561 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:53.988679 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:53.989863 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:53.990895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:53.991659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:54.120413 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] HTTP exception thrown: Invalid volume: volume 90deda31-164f-4b61-b884-3598c3c3019e is already attached to instances: 291df513-4591-43c9-89d7-f9974ba6f5c2 Feb 21 02:29:54.121244 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Returning 400 to user: Invalid volume: volume 90deda31-164f-4b61-b884-3598c3c3019e is already attached to instances: 291df513-4591-43c9-89d7-f9974ba6f5c2 {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:29:54.122300 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-06cee0cc-87c6-40c8-a2e2-9c6fb81761d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147186 Feb 21 02:29:54.124058 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 198/379] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:29:53 2022] POST /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 02:29:54.246040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-431b8732-7c79-47b0-aeb0-94a065797d3c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:54.246751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-431b8732-7c79-47b0-aeb0-94a065797d3c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:54.257129 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-431b8732-7c79-47b0-aeb0-94a065797d3c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:54.260271 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-431b8732-7c79-47b0-aeb0-94a065797d3c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:54.261187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-431b8732-7c79-47b0-aeb0-94a065797d3c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:54.261722 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-431b8732-7c79-47b0-aeb0-94a065797d3c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:54.466302 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-431b8732-7c79-47b0-aeb0-94a065797d3c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'services' on Instance uuid 291df513-4591-43c9-89d7-f9974ba6f5c2 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:29:54.623202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-431b8732-7c79-47b0-aeb0-94a065797d3c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "DELETE /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments/90deda31-164f-4b61-b884-3598c3c3019e" status: 202 len: 0 microversion: 2.1 time: 0.381305 Feb 21 02:29:54.629404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 182/380] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:29:54 2022] DELETE /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments/90deda31-164f-4b61-b884-3598c3c3019e => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:29:54.644344 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ea37cdda-56fd-4c9e-99b9-9c54e5936309 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:54.645461 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ea37cdda-56fd-4c9e-99b9-9c54e5936309 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:54.671027 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea37cdda-56fd-4c9e-99b9-9c54e5936309 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:54.671949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea37cdda-56fd-4c9e-99b9-9c54e5936309 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:54.673297 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea37cdda-56fd-4c9e-99b9-9c54e5936309 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:54.674069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea37cdda-56fd-4c9e-99b9-9c54e5936309 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:54.722331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ea37cdda-56fd-4c9e-99b9-9c54e5936309 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084744 Feb 21 02:29:54.722984 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 199/381] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:54 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:55.738903 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3df0e2be-5433-4423-9328-f95334b7e5c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:55.739960 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3df0e2be-5433-4423-9328-f95334b7e5c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:55.746137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3df0e2be-5433-4423-9328-f95334b7e5c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:55.746579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3df0e2be-5433-4423-9328-f95334b7e5c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:55.747512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3df0e2be-5433-4423-9328-f95334b7e5c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:55.748156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3df0e2be-5433-4423-9328-f95334b7e5c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:55.779787 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3df0e2be-5433-4423-9328-f95334b7e5c8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046520 Feb 21 02:29:55.780478 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 183/382] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:55 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:29:56.059212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-471193456", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "26881fc9-45ba-431f-a03d-7739d0624db9"}]}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:29:56.790880 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-85b56a55-7490-4321-82df-08752a80d9b1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:56.791988 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-85b56a55-7490-4321-82df-08752a80d9b1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:56.801357 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85b56a55-7490-4321-82df-08752a80d9b1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:56.801829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85b56a55-7490-4321-82df-08752a80d9b1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:56.802661 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85b56a55-7490-4321-82df-08752a80d9b1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:56.803189 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85b56a55-7490-4321-82df-08752a80d9b1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:56.839408 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-85b56a55-7490-4321-82df-08752a80d9b1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051916 Feb 21 02:29:56.840157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 184/383] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:56 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:29:57.851753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6775aed9-0328-489b-bd05-79b51858fc72 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:57.852658 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6775aed9-0328-489b-bd05-79b51858fc72 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:57.859011 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6775aed9-0328-489b-bd05-79b51858fc72 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:57.859463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6775aed9-0328-489b-bd05-79b51858fc72 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:57.860501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6775aed9-0328-489b-bd05-79b51858fc72 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:57.860940 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6775aed9-0328-489b-bd05-79b51858fc72 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:57.895731 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6775aed9-0328-489b-bd05-79b51858fc72 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 Feb 21 02:29:57.896454 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 185/384] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:57 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:29:58.910887 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5d701f38-e377-4b92-9b4b-9bbfc3ee27fb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:58.912511 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5d701f38-e377-4b92-9b4b-9bbfc3ee27fb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:58.919575 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5d701f38-e377-4b92-9b4b-9bbfc3ee27fb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:58.920032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5d701f38-e377-4b92-9b4b-9bbfc3ee27fb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:58.920839 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5d701f38-e377-4b92-9b4b-9bbfc3ee27fb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:58.921276 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5d701f38-e377-4b92-9b4b-9bbfc3ee27fb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:58.960569 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5d701f38-e377-4b92-9b4b-9bbfc3ee27fb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054516 Feb 21 02:29:58.961235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 186/385] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:58 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:29:59.974414 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-684b3778-0800-4746-bd10-027bbc04e58b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:29:59.976406 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-684b3778-0800-4746-bd10-027bbc04e58b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:29:59.984311 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-684b3778-0800-4746-bd10-027bbc04e58b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:59.985372 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-684b3778-0800-4746-bd10-027bbc04e58b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:29:59.986397 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-684b3778-0800-4746-bd10-027bbc04e58b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:29:59.988775 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-684b3778-0800-4746-bd10-027bbc04e58b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:00.030073 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-684b3778-0800-4746-bd10-027bbc04e58b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060981 Feb 21 02:30:00.031036 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 187/386] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:29:59 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:01.042428 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4111ba89-c3be-4196-b326-c6f857ac8c44 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:01.043488 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4111ba89-c3be-4196-b326-c6f857ac8c44 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:01.050934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4111ba89-c3be-4196-b326-c6f857ac8c44 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:01.051679 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4111ba89-c3be-4196-b326-c6f857ac8c44 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:01.052473 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4111ba89-c3be-4196-b326-c6f857ac8c44 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:01.052940 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4111ba89-c3be-4196-b326-c6f857ac8c44 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:01.087134 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4111ba89-c3be-4196-b326-c6f857ac8c44 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048439 Feb 21 02:30:01.087607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 188/387] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:01 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:30:01.315545 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4cedbd4b-4e58-4b5e-a844-d8dcaf4fa001 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:01.316995 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4cedbd4b-4e58-4b5e-a844-d8dcaf4fa001 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:01.327694 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cedbd4b-4e58-4b5e-a844-d8dcaf4fa001 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:01.328145 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cedbd4b-4e58-4b5e-a844-d8dcaf4fa001 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:01.328946 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cedbd4b-4e58-4b5e-a844-d8dcaf4fa001 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:01.329382 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cedbd4b-4e58-4b5e-a844-d8dcaf4fa001 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:01.357996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-4cedbd4b-4e58-4b5e-a844-d8dcaf4fa001 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lazy-loading 'flavor' on Instance uuid 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:01.542160 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4cedbd4b-4e58-4b5e-a844-d8dcaf4fa001 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/action" status: 200 len: 32 microversion: 2.1 time: 0.236906 Feb 21 02:30:01.543247 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 189/388] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:30:01 2022] POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 02:30:01.553434 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c86b9d8a-f437-40df-bed2-7334a58d1626 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:01.561755 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c86b9d8a-f437-40df-bed2-7334a58d1626 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:01.570321 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c86b9d8a-f437-40df-bed2-7334a58d1626 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:01.571053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c86b9d8a-f437-40df-bed2-7334a58d1626 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:01.571977 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c86b9d8a-f437-40df-bed2-7334a58d1626 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:01.572506 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c86b9d8a-f437-40df-bed2-7334a58d1626 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:01.818644 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c86b9d8a-f437-40df-bed2-7334a58d1626 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:01.830052 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c86b9d8a-f437-40df-bed2-7334a58d1626 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.280970 Feb 21 02:30:01.840131 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 190/389] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:01 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:02.099187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4bbfb8bb-0bf1-4228-97b8-8cb6f7242aea tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:02.100317 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4bbfb8bb-0bf1-4228-97b8-8cb6f7242aea tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:02.107020 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4bbfb8bb-0bf1-4228-97b8-8cb6f7242aea tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:02.107687 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4bbfb8bb-0bf1-4228-97b8-8cb6f7242aea tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:02.108502 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4bbfb8bb-0bf1-4228-97b8-8cb6f7242aea tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:02.108936 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4bbfb8bb-0bf1-4228-97b8-8cb6f7242aea tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:02.142262 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4bbfb8bb-0bf1-4228-97b8-8cb6f7242aea tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047518 Feb 21 02:30:02.143871 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 191/390] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:02 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 02:30:02.322819 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-923223962", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "d4d7fbe4-b74f-4889-adca-b065ca5bd2cf"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:02.777534 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] validate_networks() for [('26881fc9-45ba-431f-a03d-7739d0624db9', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:30:02.788862 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] validate_networks() for [('d4d7fbe4-b74f-4889-adca-b065ca5bd2cf', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:30:03.139761 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:30:03.140649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:30:03.141328 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:30:03.141783 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:30:03.142360 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:30:03.154888 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:03.155355 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:03.156244 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:03.156688 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:03.179478 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Getting quotas for project 85d4895c6155469e9922d6ad6e152051. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:30:03.183977 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Getting quotas for user 8518b2eaf3144249af9733b819aa27d6 and project 85d4895c6155469e9922d6ad6e152051. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:30:03.195512 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:30:03.197864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:30:03.258129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d9e7145b-6738-4c70-9683-7568e325ec35 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.202361 Feb 21 02:30:03.269498 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 200/391] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:29:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 7212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:30:03.274789 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1131a407-3e3f-4e71-ab42-073fc66d75e4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:03.275722 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1131a407-3e3f-4e71-ab42-073fc66d75e4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:03.286327 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1131a407-3e3f-4e71-ab42-073fc66d75e4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:03.287094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1131a407-3e3f-4e71-ab42-073fc66d75e4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:03.288217 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1131a407-3e3f-4e71-ab42-073fc66d75e4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:03.288855 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1131a407-3e3f-4e71-ab42-073fc66d75e4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:03.451958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1131a407-3e3f-4e71-ab42-073fc66d75e4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:03.469423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1131a407-3e3f-4e71-ab42-073fc66d75e4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.198455 Feb 21 02:30:03.477095 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 201/392] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:03 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:03.484469 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2eb1b2f5-5e7b-4ccd-9e45-7179389aff03 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:03.485797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2eb1b2f5-5e7b-4ccd-9e45-7179389aff03 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:03.549138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2eb1b2f5-5e7b-4ccd-9e45-7179389aff03 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:03.556088 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2eb1b2f5-5e7b-4ccd-9e45-7179389aff03 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1218 microversion: 2.1 time: 0.077673 Feb 21 02:30:03.568058 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 202/393] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:03 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:03.620097 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:30:03.621350 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:30:03.622059 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:30:03.622665 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:30:03.623284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:30:03.652134 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:03.653105 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:03.654602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:03.655443 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:03.687486 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Getting quotas for project 440cb05903bb427baa54dbe25b56ee7c. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:30:03.694355 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Getting quotas for user 533f0f53f5504f0caec419a41f0f7452 and project 440cb05903bb427baa54dbe25b56ee7c. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:30:03.716976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:30:03.719329 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:30:03.794122 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-66bb31ad-0d11-4e63-a35f-b7cad1b614b8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.474815 Feb 21 02:30:03.797194 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 192/394] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 02:30:03.823406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-696cf839-22fa-4d6d-af96-27288f926cb5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:03.824041 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-696cf839-22fa-4d6d-af96-27288f926cb5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:03.929825 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-696cf839-22fa-4d6d-af96-27288f926cb5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:03.968881 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-696cf839-22fa-4d6d-af96-27288f926cb5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1217 microversion: 2.1 time: 0.142415 Feb 21 02:30:03.968881 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 203/395] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:03 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:04.491101 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-de146aa4-8054-4447-915b-a2e242fbae62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:04.492008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-de146aa4-8054-4447-915b-a2e242fbae62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:04.498317 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-de146aa4-8054-4447-915b-a2e242fbae62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:04.499009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-de146aa4-8054-4447-915b-a2e242fbae62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:04.499790 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-de146aa4-8054-4447-915b-a2e242fbae62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:04.500387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-de146aa4-8054-4447-915b-a2e242fbae62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:04.574332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-84be6753-500e-4ec4-994c-9cf6cd80ef6f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:04.575128 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-84be6753-500e-4ec4-994c-9cf6cd80ef6f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:04.583934 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-84be6753-500e-4ec4-994c-9cf6cd80ef6f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:04.584647 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-84be6753-500e-4ec4-994c-9cf6cd80ef6f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:04.585440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-84be6753-500e-4ec4-994c-9cf6cd80ef6f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:04.585896 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-84be6753-500e-4ec4-994c-9cf6cd80ef6f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:04.677673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-84be6753-500e-4ec4-994c-9cf6cd80ef6f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:04.696523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-84be6753-500e-4ec4-994c-9cf6cd80ef6f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1270 microversion: 2.1 time: 0.121324 Feb 21 02:30:04.698496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 204/396] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:04 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:04.740850 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-de146aa4-8054-4447-915b-a2e242fbae62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:04.748972 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-de146aa4-8054-4447-915b-a2e242fbae62 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.263063 Feb 21 02:30:04.750619 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 193/397] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:04 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:04.985738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-61d6348c-56a8-4ca9-ab45-550ba82d862d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:04.987019 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-61d6348c-56a8-4ca9-ab45-550ba82d862d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:04.997035 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-61d6348c-56a8-4ca9-ab45-550ba82d862d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:04.998899 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-61d6348c-56a8-4ca9-ab45-550ba82d862d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:05.000453 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-61d6348c-56a8-4ca9-ab45-550ba82d862d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:05.001048 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-61d6348c-56a8-4ca9-ab45-550ba82d862d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:05.072357 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-61d6348c-56a8-4ca9-ab45-550ba82d862d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:05.080340 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-61d6348c-56a8-4ca9-ab45-550ba82d862d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1277 microversion: 2.1 time: 0.100169 Feb 21 02:30:05.080922 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 205/398] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:04 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:05.717422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fbd3d83a-c8e4-4ce6-82d1-fd890e341695 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:05.718354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fbd3d83a-c8e4-4ce6-82d1-fd890e341695 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:05.727900 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fbd3d83a-c8e4-4ce6-82d1-fd890e341695 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:05.729682 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fbd3d83a-c8e4-4ce6-82d1-fd890e341695 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:05.730842 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fbd3d83a-c8e4-4ce6-82d1-fd890e341695 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:05.731683 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fbd3d83a-c8e4-4ce6-82d1-fd890e341695 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:05.767286 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-76489021-f890-401f-88db-a3103a68ac8c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:05.768794 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-76489021-f890-401f-88db-a3103a68ac8c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:05.781283 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-76489021-f890-401f-88db-a3103a68ac8c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:05.783007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-76489021-f890-401f-88db-a3103a68ac8c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:05.785460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-76489021-f890-401f-88db-a3103a68ac8c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:05.786137 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-76489021-f890-401f-88db-a3103a68ac8c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:05.831354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fbd3d83a-c8e4-4ce6-82d1-fd890e341695 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:05.841455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fbd3d83a-c8e4-4ce6-82d1-fd890e341695 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1276 microversion: 2.1 time: 0.128443 Feb 21 02:30:05.843022 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 194/399] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:05 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:06.017075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-76489021-f890-401f-88db-a3103a68ac8c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:06.027268 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-76489021-f890-401f-88db-a3103a68ac8c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.264254 Feb 21 02:30:06.027964 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 206/400] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:05 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:06.097781 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e2d7d4c4-38f5-493f-8897-dd7492e037fe tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:06.098681 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e2d7d4c4-38f5-493f-8897-dd7492e037fe tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:06.104772 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2d7d4c4-38f5-493f-8897-dd7492e037fe tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:06.105431 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2d7d4c4-38f5-493f-8897-dd7492e037fe tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:06.106422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2d7d4c4-38f5-493f-8897-dd7492e037fe tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:06.107175 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2d7d4c4-38f5-493f-8897-dd7492e037fe tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:06.805164 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e2d7d4c4-38f5-493f-8897-dd7492e037fe tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:06.815221 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e2d7d4c4-38f5-493f-8897-dd7492e037fe tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.720533 Feb 21 02:30:06.826001 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 195/401] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:06 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:06.863696 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c21e41bd-1155-449d-bd3b-82bc866830c5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:06.865194 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c21e41bd-1155-449d-bd3b-82bc866830c5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:06.872504 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c21e41bd-1155-449d-bd3b-82bc866830c5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:06.873415 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c21e41bd-1155-449d-bd3b-82bc866830c5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:06.875003 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c21e41bd-1155-449d-bd3b-82bc866830c5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:06.875683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c21e41bd-1155-449d-bd3b-82bc866830c5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:07.030753 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c21e41bd-1155-449d-bd3b-82bc866830c5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:07.043038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c21e41bd-1155-449d-bd3b-82bc866830c5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.185405 Feb 21 02:30:07.044710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7cfa5877-2150-4b81-86a2-b700652002c4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:07.045939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7cfa5877-2150-4b81-86a2-b700652002c4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:07.053127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 207/402] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:06 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:07.055005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7cfa5877-2150-4b81-86a2-b700652002c4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:07.055803 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7cfa5877-2150-4b81-86a2-b700652002c4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:07.058389 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7cfa5877-2150-4b81-86a2-b700652002c4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:07.059076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7cfa5877-2150-4b81-86a2-b700652002c4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:07.400898 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7cfa5877-2150-4b81-86a2-b700652002c4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:07.411207 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7cfa5877-2150-4b81-86a2-b700652002c4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.370665 Feb 21 02:30:07.412403 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 196/403] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:07 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:07.642848 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-349ebc09-6cd6-44da-88af-44bcfae36716 req-2e1ea8d1-629a-4d43-b8b7-5782f136edad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecd84e6-18a9-4335-8476-507d531cda92", "tag": "2021a41e-916a-4ed6-a694-a01cc08dc51c"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:07.656802 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:07.656802 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:30:07.674459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-349ebc09-6cd6-44da-88af-44bcfae36716 req-2e1ea8d1-629a-4d43-b8b7-5782f136edad service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:07.675176 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-349ebc09-6cd6-44da-88af-44bcfae36716 req-2e1ea8d1-629a-4d43-b8b7-5782f136edad service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:07.705432 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-349ebc09-6cd6-44da-88af-44bcfae36716 req-2e1ea8d1-629a-4d43-b8b7-5782f136edad service nova] Creating event network-changed:2021a41e-916a-4ed6-a694-a01cc08dc51c for instance 9ecd84e6-18a9-4335-8476-507d531cda92 on hv-cinder-80447 Feb 21 02:30:07.719593 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-349ebc09-6cd6-44da-88af-44bcfae36716 req-2e1ea8d1-629a-4d43-b8b7-5782f136edad service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083967 Feb 21 02:30:07.720185 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 208/404] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:07.832941 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e4faaf87-48c3-42c0-b069-33dc4e647e02 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:07.833790 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e4faaf87-48c3-42c0-b069-33dc4e647e02 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:07.841462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e4faaf87-48c3-42c0-b069-33dc4e647e02 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:07.842047 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e4faaf87-48c3-42c0-b069-33dc4e647e02 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:07.842912 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e4faaf87-48c3-42c0-b069-33dc4e647e02 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:07.843472 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e4faaf87-48c3-42c0-b069-33dc4e647e02 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:08.062851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-058342f0-d143-42a1-bf4b-b697a46413ff tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:08.065586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-058342f0-d143-42a1-bf4b-b697a46413ff tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:08.080531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-058342f0-d143-42a1-bf4b-b697a46413ff tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:08.081509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-058342f0-d143-42a1-bf4b-b697a46413ff tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:08.083141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-058342f0-d143-42a1-bf4b-b697a46413ff tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:08.084256 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-058342f0-d143-42a1-bf4b-b697a46413ff tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:08.229273 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e4faaf87-48c3-42c0-b069-33dc4e647e02 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:08.243471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e4faaf87-48c3-42c0-b069-33dc4e647e02 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.414478 Feb 21 02:30:08.244777 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 197/405] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:07 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:08.271349 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-058342f0-d143-42a1-bf4b-b697a46413ff tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:08.280959 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-058342f0-d143-42a1-bf4b-b697a46413ff tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.222318 Feb 21 02:30:08.281791 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 209/406] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:08 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:08.428270 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7ad310db-6934-43f3-8b18-5a204ec163d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:08.429004 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7ad310db-6934-43f3-8b18-5a204ec163d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:08.435577 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7ad310db-6934-43f3-8b18-5a204ec163d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:08.436130 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7ad310db-6934-43f3-8b18-5a204ec163d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:08.437017 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7ad310db-6934-43f3-8b18-5a204ec163d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:08.437536 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7ad310db-6934-43f3-8b18-5a204ec163d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:08.833162 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7ad310db-6934-43f3-8b18-5a204ec163d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:08.841232 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7ad310db-6934-43f3-8b18-5a204ec163d2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.416733 Feb 21 02:30:08.841854 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 198/407] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:08 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:09.260577 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7785fe0d-59bc-46f2-9963-f65821acab5f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:09.261187 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7785fe0d-59bc-46f2-9963-f65821acab5f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:09.267513 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7785fe0d-59bc-46f2-9963-f65821acab5f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:09.268114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7785fe0d-59bc-46f2-9963-f65821acab5f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:09.268913 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7785fe0d-59bc-46f2-9963-f65821acab5f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:09.269353 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7785fe0d-59bc-46f2-9963-f65821acab5f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:09.300322 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3228304b-6ba3-46c5-82a0-ede2d41fd8ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:09.300954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3228304b-6ba3-46c5-82a0-ede2d41fd8ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:09.306976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3228304b-6ba3-46c5-82a0-ede2d41fd8ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:09.307701 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3228304b-6ba3-46c5-82a0-ede2d41fd8ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:09.308580 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3228304b-6ba3-46c5-82a0-ede2d41fd8ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:09.309224 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3228304b-6ba3-46c5-82a0-ede2d41fd8ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:09.408891 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7785fe0d-59bc-46f2-9963-f65821acab5f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:09.416089 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7785fe0d-59bc-46f2-9963-f65821acab5f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.159237 Feb 21 02:30:09.416669 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 210/408] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:09 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:09.455207 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3228304b-6ba3-46c5-82a0-ede2d41fd8ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:09.462355 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3228304b-6ba3-46c5-82a0-ede2d41fd8ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.167458 Feb 21 02:30:09.462912 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 199/409] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:09 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:09.743261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-f9691ab0-c214-4935-b39b-bfc469f86ab6 req-fd1f5527-dff1-4f45-9537-d0f90d751102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15be83cb-8289-45b8-950c-8677b8b55d6a", "tag": "229a501b-9d18-485b-9959-7236956c786a"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:09.744834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:09.744834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:30:09.751599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-f9691ab0-c214-4935-b39b-bfc469f86ab6 req-fd1f5527-dff1-4f45-9537-d0f90d751102 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:09.752039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-f9691ab0-c214-4935-b39b-bfc469f86ab6 req-fd1f5527-dff1-4f45-9537-d0f90d751102 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:09.762452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-f9691ab0-c214-4935-b39b-bfc469f86ab6 req-fd1f5527-dff1-4f45-9537-d0f90d751102 service nova] Creating event network-changed:229a501b-9d18-485b-9959-7236956c786a for instance 15be83cb-8289-45b8-950c-8677b8b55d6a on hv-cinder-80447 Feb 21 02:30:09.767906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-f9691ab0-c214-4935-b39b-bfc469f86ab6 req-fd1f5527-dff1-4f45-9537-d0f90d751102 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028105 Feb 21 02:30:09.768507 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 211/410] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:09.858083 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8d2f4c92-d094-4e86-a6aa-3377b07473e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:09.858681 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8d2f4c92-d094-4e86-a6aa-3377b07473e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:09.865695 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d2f4c92-d094-4e86-a6aa-3377b07473e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:09.866139 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d2f4c92-d094-4e86-a6aa-3377b07473e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:09.866907 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d2f4c92-d094-4e86-a6aa-3377b07473e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:09.867332 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d2f4c92-d094-4e86-a6aa-3377b07473e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:10.098298 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8d2f4c92-d094-4e86-a6aa-3377b07473e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:10.106091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8d2f4c92-d094-4e86-a6aa-3377b07473e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.251573 Feb 21 02:30:10.106859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 200/411] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:09 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:10.434655 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b86e2736-5bc6-4a9b-b067-a22f26df8188 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:10.435371 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b86e2736-5bc6-4a9b-b067-a22f26df8188 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:10.442767 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b86e2736-5bc6-4a9b-b067-a22f26df8188 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:10.443210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b86e2736-5bc6-4a9b-b067-a22f26df8188 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:10.443988 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b86e2736-5bc6-4a9b-b067-a22f26df8188 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:10.444592 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b86e2736-5bc6-4a9b-b067-a22f26df8188 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:10.479293 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-34df0c41-4440-499e-b46d-44b76c3dac8c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:10.479853 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-34df0c41-4440-499e-b46d-44b76c3dac8c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:10.486113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-34df0c41-4440-499e-b46d-44b76c3dac8c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:10.486668 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-34df0c41-4440-499e-b46d-44b76c3dac8c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:10.487453 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-34df0c41-4440-499e-b46d-44b76c3dac8c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:10.487880 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-34df0c41-4440-499e-b46d-44b76c3dac8c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:10.593539 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b86e2736-5bc6-4a9b-b067-a22f26df8188 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:10.601893 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b86e2736-5bc6-4a9b-b067-a22f26df8188 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.171816 Feb 21 02:30:10.602500 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 212/412] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:10 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:10.644030 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-34df0c41-4440-499e-b46d-44b76c3dac8c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:10.651252 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-34df0c41-4440-499e-b46d-44b76c3dac8c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.175596 Feb 21 02:30:10.651823 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 201/413] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:10 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:11.123295 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-02fc3533-275e-4319-a4b1-9c272bcfcb88 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:11.123902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-02fc3533-275e-4319-a4b1-9c272bcfcb88 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:11.129834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-02fc3533-275e-4319-a4b1-9c272bcfcb88 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:11.130275 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-02fc3533-275e-4319-a4b1-9c272bcfcb88 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:11.131051 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-02fc3533-275e-4319-a4b1-9c272bcfcb88 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:11.131487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-02fc3533-275e-4319-a4b1-9c272bcfcb88 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:11.265474 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-02fc3533-275e-4319-a4b1-9c272bcfcb88 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:11.273631 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-02fc3533-275e-4319-a4b1-9c272bcfcb88 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.153952 Feb 21 02:30:11.274245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 213/414] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:11 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:11.618346 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ba0b3f8a-3965-4c32-9a5d-5a83aee826f0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:11.618943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ba0b3f8a-3965-4c32-9a5d-5a83aee826f0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:11.625069 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba0b3f8a-3965-4c32-9a5d-5a83aee826f0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:11.625509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba0b3f8a-3965-4c32-9a5d-5a83aee826f0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:11.626309 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba0b3f8a-3965-4c32-9a5d-5a83aee826f0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:11.626739 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba0b3f8a-3965-4c32-9a5d-5a83aee826f0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:11.667759 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5c6bf5f5-1fe6-4f67-9991-99de53bf7f0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:11.668368 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5c6bf5f5-1fe6-4f67-9991-99de53bf7f0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:11.675287 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5c6bf5f5-1fe6-4f67-9991-99de53bf7f0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:11.675732 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5c6bf5f5-1fe6-4f67-9991-99de53bf7f0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:11.676509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5c6bf5f5-1fe6-4f67-9991-99de53bf7f0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:11.676936 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5c6bf5f5-1fe6-4f67-9991-99de53bf7f0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:11.760158 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ba0b3f8a-3965-4c32-9a5d-5a83aee826f0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:11.767463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ba0b3f8a-3965-4c32-9a5d-5a83aee826f0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.152701 Feb 21 02:30:11.768167 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 202/415] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:11 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:11.826096 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5c6bf5f5-1fe6-4f67-9991-99de53bf7f0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:11.833320 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5c6bf5f5-1fe6-4f67-9991-99de53bf7f0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.169069 Feb 21 02:30:11.833918 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 214/416] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:11 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:12.290943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4ac8901a-c6ee-4af7-8cdc-444deefbf9b1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:12.291547 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4ac8901a-c6ee-4af7-8cdc-444deefbf9b1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:12.297220 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4ac8901a-c6ee-4af7-8cdc-444deefbf9b1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:12.297688 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4ac8901a-c6ee-4af7-8cdc-444deefbf9b1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:12.298462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4ac8901a-c6ee-4af7-8cdc-444deefbf9b1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:12.299012 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4ac8901a-c6ee-4af7-8cdc-444deefbf9b1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:12.456535 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4ac8901a-c6ee-4af7-8cdc-444deefbf9b1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:12.464156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4ac8901a-c6ee-4af7-8cdc-444deefbf9b1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.177034 Feb 21 02:30:12.464715 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 203/417] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:12 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:12.784910 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d85c0fed-f1ce-42a5-a3f9-4351e543ab17 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:12.785903 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d85c0fed-f1ce-42a5-a3f9-4351e543ab17 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:12.792880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d85c0fed-f1ce-42a5-a3f9-4351e543ab17 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:12.793323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d85c0fed-f1ce-42a5-a3f9-4351e543ab17 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:12.794140 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d85c0fed-f1ce-42a5-a3f9-4351e543ab17 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:12.794709 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d85c0fed-f1ce-42a5-a3f9-4351e543ab17 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:12.850984 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-55511589-3eed-4700-86a4-252323b873e8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:12.852589 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-55511589-3eed-4700-86a4-252323b873e8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:12.862658 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55511589-3eed-4700-86a4-252323b873e8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:12.863666 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55511589-3eed-4700-86a4-252323b873e8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:12.864172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55511589-3eed-4700-86a4-252323b873e8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:12.865150 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55511589-3eed-4700-86a4-252323b873e8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:12.977308 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d85c0fed-f1ce-42a5-a3f9-4351e543ab17 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:12.985468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d85c0fed-f1ce-42a5-a3f9-4351e543ab17 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.205036 Feb 21 02:30:12.986085 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 215/418] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:12 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:13.047131 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-55511589-3eed-4700-86a4-252323b873e8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:13.055434 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-55511589-3eed-4700-86a4-252323b873e8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.208286 Feb 21 02:30:13.056361 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 204/419] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:12 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:13.481538 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a8c78cd9-9e82-461a-a515-3da5111ac9ae tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:13.482187 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a8c78cd9-9e82-461a-a515-3da5111ac9ae tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:13.489516 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a8c78cd9-9e82-461a-a515-3da5111ac9ae tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:13.489995 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a8c78cd9-9e82-461a-a515-3da5111ac9ae tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:13.490907 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a8c78cd9-9e82-461a-a515-3da5111ac9ae tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:13.491241 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a8c78cd9-9e82-461a-a515-3da5111ac9ae tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:13.630861 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a8c78cd9-9e82-461a-a515-3da5111ac9ae tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:13.638669 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a8c78cd9-9e82-461a-a515-3da5111ac9ae tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.160753 Feb 21 02:30:13.639518 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 216/420] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:13 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:14.005069 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6e1e22ff-0e26-4380-b967-bf154ff6268a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:14.005719 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6e1e22ff-0e26-4380-b967-bf154ff6268a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:14.012013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6e1e22ff-0e26-4380-b967-bf154ff6268a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:14.013042 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6e1e22ff-0e26-4380-b967-bf154ff6268a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:14.014184 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6e1e22ff-0e26-4380-b967-bf154ff6268a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:14.014895 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6e1e22ff-0e26-4380-b967-bf154ff6268a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:14.077659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5c55a071-2a24-4f8e-a361-c982c0d5aba6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:14.078414 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5c55a071-2a24-4f8e-a361-c982c0d5aba6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:14.087624 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5c55a071-2a24-4f8e-a361-c982c0d5aba6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:14.087947 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5c55a071-2a24-4f8e-a361-c982c0d5aba6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:14.088762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5c55a071-2a24-4f8e-a361-c982c0d5aba6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:14.089193 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5c55a071-2a24-4f8e-a361-c982c0d5aba6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:14.182286 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6e1e22ff-0e26-4380-b967-bf154ff6268a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:14.190907 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6e1e22ff-0e26-4380-b967-bf154ff6268a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.190488 Feb 21 02:30:14.191774 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 205/421] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:13 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:14.229448 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5c55a071-2a24-4f8e-a361-c982c0d5aba6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:14.237375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5c55a071-2a24-4f8e-a361-c982c0d5aba6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.166825 Feb 21 02:30:14.237965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 217/422] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:14 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:14.656105 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-558022cd-8433-452d-97c3-d853c13a772b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:14.656708 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-558022cd-8433-452d-97c3-d853c13a772b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:14.662828 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-558022cd-8433-452d-97c3-d853c13a772b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:14.663276 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-558022cd-8433-452d-97c3-d853c13a772b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:14.664048 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-558022cd-8433-452d-97c3-d853c13a772b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:14.664485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-558022cd-8433-452d-97c3-d853c13a772b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:14.804033 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-558022cd-8433-452d-97c3-d853c13a772b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:14.811746 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-558022cd-8433-452d-97c3-d853c13a772b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.159292 Feb 21 02:30:14.812308 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 206/423] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:14 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:15.208368 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5ae80ce2-5c5c-4f8d-9fdd-8f68380f9b89 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:15.209853 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5ae80ce2-5c5c-4f8d-9fdd-8f68380f9b89 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:15.216148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5ae80ce2-5c5c-4f8d-9fdd-8f68380f9b89 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:15.216663 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5ae80ce2-5c5c-4f8d-9fdd-8f68380f9b89 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:15.217524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5ae80ce2-5c5c-4f8d-9fdd-8f68380f9b89 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:15.217982 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5ae80ce2-5c5c-4f8d-9fdd-8f68380f9b89 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:15.255040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3e077172-0f48-43ad-9fe7-bc86417db627 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:15.256532 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3e077172-0f48-43ad-9fe7-bc86417db627 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:15.263975 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e077172-0f48-43ad-9fe7-bc86417db627 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:15.264724 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e077172-0f48-43ad-9fe7-bc86417db627 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:15.265624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e077172-0f48-43ad-9fe7-bc86417db627 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:15.266190 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3e077172-0f48-43ad-9fe7-bc86417db627 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:15.460773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3e077172-0f48-43ad-9fe7-bc86417db627 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:15.476764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3e077172-0f48-43ad-9fe7-bc86417db627 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.220970 Feb 21 02:30:15.476764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 207/424] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:15 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:15.599106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5ae80ce2-5c5c-4f8d-9fdd-8f68380f9b89 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:15.607473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5ae80ce2-5c5c-4f8d-9fdd-8f68380f9b89 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.403258 Feb 21 02:30:15.608046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 218/425] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:15 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:15.829218 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-54076ccb-a803-4237-8a59-8cb85397a6e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:15.829859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-54076ccb-a803-4237-8a59-8cb85397a6e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:15.836184 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-54076ccb-a803-4237-8a59-8cb85397a6e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:15.836634 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-54076ccb-a803-4237-8a59-8cb85397a6e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:15.837399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-54076ccb-a803-4237-8a59-8cb85397a6e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:15.837864 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-54076ccb-a803-4237-8a59-8cb85397a6e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:15.986625 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-54076ccb-a803-4237-8a59-8cb85397a6e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:15.996014 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-54076ccb-a803-4237-8a59-8cb85397a6e0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.170382 Feb 21 02:30:15.996581 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 208/426] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:15 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:16.489534 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7088d3ec-a750-4165-829c-2ddeecb2c3b5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:16.490170 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7088d3ec-a750-4165-829c-2ddeecb2c3b5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:16.496526 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7088d3ec-a750-4165-829c-2ddeecb2c3b5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:16.496972 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7088d3ec-a750-4165-829c-2ddeecb2c3b5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:16.497779 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7088d3ec-a750-4165-829c-2ddeecb2c3b5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:16.498216 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7088d3ec-a750-4165-829c-2ddeecb2c3b5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:16.624268 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-dbf150db-32e9-4906-9220-3f6fcda88970 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:16.624881 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-dbf150db-32e9-4906-9220-3f6fcda88970 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:16.632862 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dbf150db-32e9-4906-9220-3f6fcda88970 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:16.634411 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dbf150db-32e9-4906-9220-3f6fcda88970 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:16.634411 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dbf150db-32e9-4906-9220-3f6fcda88970 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:16.634832 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dbf150db-32e9-4906-9220-3f6fcda88970 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:16.637689 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7088d3ec-a750-4165-829c-2ddeecb2c3b5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:16.645472 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7088d3ec-a750-4165-829c-2ddeecb2c3b5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.159474 Feb 21 02:30:16.646409 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 219/427] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:16 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:16.780057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-dbf150db-32e9-4906-9220-3f6fcda88970 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:16.787462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-dbf150db-32e9-4906-9220-3f6fcda88970 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.166772 Feb 21 02:30:16.788019 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 209/428] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:16 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:17.013587 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-736214ae-5afd-466a-a1c6-1b533dc342ec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:17.014219 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-736214ae-5afd-466a-a1c6-1b533dc342ec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:17.020203 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-736214ae-5afd-466a-a1c6-1b533dc342ec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:17.020649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-736214ae-5afd-466a-a1c6-1b533dc342ec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:17.021423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-736214ae-5afd-466a-a1c6-1b533dc342ec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:17.021893 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-736214ae-5afd-466a-a1c6-1b533dc342ec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:17.159850 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-736214ae-5afd-466a-a1c6-1b533dc342ec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:17.167575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-736214ae-5afd-466a-a1c6-1b533dc342ec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.157760 Feb 21 02:30:17.168128 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 220/429] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:17 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:17.663962 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fc64afc7-801b-4bf1-b5cb-86e6fb71c28f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:17.664565 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fc64afc7-801b-4bf1-b5cb-86e6fb71c28f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:17.670943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fc64afc7-801b-4bf1-b5cb-86e6fb71c28f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:17.671378 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fc64afc7-801b-4bf1-b5cb-86e6fb71c28f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:17.672136 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fc64afc7-801b-4bf1-b5cb-86e6fb71c28f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:17.672560 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fc64afc7-801b-4bf1-b5cb-86e6fb71c28f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:17.805276 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fc64afc7-801b-4bf1-b5cb-86e6fb71c28f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:17.805464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-53f9f196-92ea-4566-b3cd-d6fc52195b62 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:17.805931 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-53f9f196-92ea-4566-b3cd-d6fc52195b62 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:17.813113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fc64afc7-801b-4bf1-b5cb-86e6fb71c28f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.152733 Feb 21 02:30:17.813299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-53f9f196-92ea-4566-b3cd-d6fc52195b62 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:17.813675 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-53f9f196-92ea-4566-b3cd-d6fc52195b62 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:17.813818 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 210/430] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:17 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:17.815007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-53f9f196-92ea-4566-b3cd-d6fc52195b62 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:17.815441 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-53f9f196-92ea-4566-b3cd-d6fc52195b62 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:17.949040 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-53f9f196-92ea-4566-b3cd-d6fc52195b62 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:17.957510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-53f9f196-92ea-4566-b3cd-d6fc52195b62 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.156651 Feb 21 02:30:17.958131 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 221/431] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:17 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:18.183710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-cb0d2b69-64c4-4482-85c8-8a5e701e0eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:18.184361 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cb0d2b69-64c4-4482-85c8-8a5e701e0eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:18.190954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cb0d2b69-64c4-4482-85c8-8a5e701e0eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:18.191399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cb0d2b69-64c4-4482-85c8-8a5e701e0eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:18.192180 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cb0d2b69-64c4-4482-85c8-8a5e701e0eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:18.192617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cb0d2b69-64c4-4482-85c8-8a5e701e0eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:18.331008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-cb0d2b69-64c4-4482-85c8-8a5e701e0eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:18.338840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-cb0d2b69-64c4-4482-85c8-8a5e701e0eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.158731 Feb 21 02:30:18.339395 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 211/432] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:18 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:18.830200 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2f1e75a1-567b-413d-9214-ce4d07f3f6e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:18.830801 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2f1e75a1-567b-413d-9214-ce4d07f3f6e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:18.836962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2f1e75a1-567b-413d-9214-ce4d07f3f6e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:18.837407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2f1e75a1-567b-413d-9214-ce4d07f3f6e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:18.838212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2f1e75a1-567b-413d-9214-ce4d07f3f6e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:18.838646 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2f1e75a1-567b-413d-9214-ce4d07f3f6e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:18.973226 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2f1e75a1-567b-413d-9214-ce4d07f3f6e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:18.975098 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-aa925b81-c258-46d4-a7fb-857e5d58defb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:18.975918 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-aa925b81-c258-46d4-a7fb-857e5d58defb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:18.981440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2f1e75a1-567b-413d-9214-ce4d07f3f6e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.154760 Feb 21 02:30:18.982046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 222/433] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:18 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:18.982542 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aa925b81-c258-46d4-a7fb-857e5d58defb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:18.983075 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aa925b81-c258-46d4-a7fb-857e5d58defb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:18.983860 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aa925b81-c258-46d4-a7fb-857e5d58defb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:18.984287 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aa925b81-c258-46d4-a7fb-857e5d58defb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:19.103407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-41a10382-6819-4b6a-bf6d-44abcb8fa467 req-dba4786b-45cb-42dc-b231-8b56df1e2368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ecd84e6-18a9-4335-8476-507d531cda92", "name": "network-vif-plugged", "status": "completed", "tag": "2021a41e-916a-4ed6-a694-a01cc08dc51c"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:19.104910 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:19.104910 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:30:19.112824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-41a10382-6819-4b6a-bf6d-44abcb8fa467 req-dba4786b-45cb-42dc-b231-8b56df1e2368 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:19.113186 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-41a10382-6819-4b6a-bf6d-44abcb8fa467 req-dba4786b-45cb-42dc-b231-8b56df1e2368 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:19.124797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-41a10382-6819-4b6a-bf6d-44abcb8fa467 req-dba4786b-45cb-42dc-b231-8b56df1e2368 service nova] Creating event network-vif-plugged:2021a41e-916a-4ed6-a694-a01cc08dc51c for instance 9ecd84e6-18a9-4335-8476-507d531cda92 on hv-cinder-80447 Feb 21 02:30:19.129208 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aa925b81-c258-46d4-a7fb-857e5d58defb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:19.130205 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-41a10382-6819-4b6a-bf6d-44abcb8fa467 req-dba4786b-45cb-42dc-b231-8b56df1e2368 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030715 Feb 21 02:30:19.131291 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 223/434] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:30:19.138602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-aa925b81-c258-46d4-a7fb-857e5d58defb tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.167930 Feb 21 02:30:19.139418 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 212/435] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:18 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:19.281606 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-380355351", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1832202538", "security_groups": [{"name": "tempest-secgroup-smoke-1107378030"}], "networks": [{"uuid": "a0e8bc4a-7ec1-4e9f-98ed-0931941bb538"}], "block_device_mapping_v2": [{"uuid": "c0d25be5-0fc4-42de-ba81-7afaf69e7a01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:19.355624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ce93cd99-53f0-4407-81db-be16b6c07a6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:19.356620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ce93cd99-53f0-4407-81db-be16b6c07a6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:19.364027 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ce93cd99-53f0-4407-81db-be16b6c07a6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:19.365174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ce93cd99-53f0-4407-81db-be16b6c07a6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:19.366323 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ce93cd99-53f0-4407-81db-be16b6c07a6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:19.366910 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ce93cd99-53f0-4407-81db-be16b6c07a6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:19.416481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] validate_networks() for [('a0e8bc4a-7ec1-4e9f-98ed-0931941bb538', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:30:19.522850 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ce93cd99-53f0-4407-81db-be16b6c07a6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:19.530491 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ce93cd99-53f0-4407-81db-be16b6c07a6c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.178587 Feb 21 02:30:19.531111 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 213/436] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:19 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:19.819285 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:30:19.819704 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:30:19.820227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:30:19.820789 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:30:19.821198 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:30:19.829845 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:19.830645 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:19.831654 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:19.832087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:19.849574 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Getting quotas for project 2c955ce069224b53aa944c7971e3650c. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:30:19.853374 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Getting quotas for user 4941ffa30a3740608a9d46b546ba6f6d and project 2c955ce069224b53aa944c7971e3650c. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:30:19.910238 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:30:19.912463 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0d25be5-0fc4-42de-ba81-7afaf69e7a01',volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:30:19.998682 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fb3d5793-1dcf-454f-a916-260d9d8c98ba tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:19.999371 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fb3d5793-1dcf-454f-a916-260d9d8c98ba tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:20.006651 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fb3d5793-1dcf-454f-a916-260d9d8c98ba tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:20.007114 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fb3d5793-1dcf-454f-a916-260d9d8c98ba tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:20.007957 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fb3d5793-1dcf-454f-a916-260d9d8c98ba tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:20.008551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fb3d5793-1dcf-454f-a916-260d9d8c98ba tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:20.038512 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f7a929bc-a1bf-4bf0-be75-10fbda150d4f tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760675 Feb 21 02:30:20.039420 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 224/437] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:30:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:30:20.049600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b40d4d3e-56db-418b-9dfd-b1321d29b719 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:20.050244 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b40d4d3e-56db-418b-9dfd-b1321d29b719 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:20.109494 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b40d4d3e-56db-418b-9dfd-b1321d29b719 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:20.117674 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b40d4d3e-56db-418b-9dfd-b1321d29b719 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1088 microversion: 2.1 time: 0.072051 Feb 21 02:30:20.118230 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 225/438] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:20 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:20.156859 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2050e452-b60a-4010-abc8-4c64c8929663 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:20.157485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2050e452-b60a-4010-abc8-4c64c8929663 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:20.164425 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2050e452-b60a-4010-abc8-4c64c8929663 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:20.165473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2050e452-b60a-4010-abc8-4c64c8929663 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:20.168462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fb3d5793-1dcf-454f-a916-260d9d8c98ba tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:20.173180 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2050e452-b60a-4010-abc8-4c64c8929663 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:20.173896 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2050e452-b60a-4010-abc8-4c64c8929663 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:20.178546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fb3d5793-1dcf-454f-a916-260d9d8c98ba tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.181669 Feb 21 02:30:20.179557 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 214/439] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:19 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:20.333535 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2050e452-b60a-4010-abc8-4c64c8929663 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:20.341892 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2050e452-b60a-4010-abc8-4c64c8929663 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.189329 Feb 21 02:30:20.342648 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 226/440] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:20 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:20.547687 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b934a071-a394-4c4d-828f-d32a0645f227 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:20.548294 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b934a071-a394-4c4d-828f-d32a0645f227 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:20.554739 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b934a071-a394-4c4d-828f-d32a0645f227 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:20.555188 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b934a071-a394-4c4d-828f-d32a0645f227 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:20.555963 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b934a071-a394-4c4d-828f-d32a0645f227 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:20.556395 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b934a071-a394-4c4d-828f-d32a0645f227 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:20.699113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b934a071-a394-4c4d-828f-d32a0645f227 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:20.709451 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b934a071-a394-4c4d-828f-d32a0645f227 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.165361 Feb 21 02:30:20.710054 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 215/441] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:20 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:21.136981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2aa1e786-ae2b-4221-85c9-0f22976d4f88 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:21.137589 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2aa1e786-ae2b-4221-85c9-0f22976d4f88 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:21.145184 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2aa1e786-ae2b-4221-85c9-0f22976d4f88 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.145908 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2aa1e786-ae2b-4221-85c9-0f22976d4f88 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.146697 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2aa1e786-ae2b-4221-85c9-0f22976d4f88 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.147337 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2aa1e786-ae2b-4221-85c9-0f22976d4f88 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.166178 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-644381ec-6abb-4179-b470-547807f04231 req-b0603c89-64b4-4ac7-b3aa-a10dc95e52dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15be83cb-8289-45b8-950c-8677b8b55d6a", "name": "network-vif-plugged", "status": "completed", "tag": "229a501b-9d18-485b-9959-7236956c786a"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:21.169267 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:21.169267 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:30:21.179194 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-644381ec-6abb-4179-b470-547807f04231 req-b0603c89-64b4-4ac7-b3aa-a10dc95e52dd service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.181923 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-644381ec-6abb-4179-b470-547807f04231 req-b0603c89-64b4-4ac7-b3aa-a10dc95e52dd service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.208667 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-644381ec-6abb-4179-b470-547807f04231 req-b0603c89-64b4-4ac7-b3aa-a10dc95e52dd service nova] Creating event network-vif-plugged:229a501b-9d18-485b-9959-7236956c786a for instance 15be83cb-8289-45b8-950c-8677b8b55d6a on hv-cinder-80447 Feb 21 02:30:21.214356 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-644381ec-6abb-4179-b470-547807f04231 req-b0603c89-64b4-4ac7-b3aa-a10dc95e52dd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057950 Feb 21 02:30:21.228824 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 216/442] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:30:21.238239 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2aa1e786-ae2b-4221-85c9-0f22976d4f88 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:21.240426 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8d024913-b79f-4165-91f9-d70e1e4cfc0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:21.241257 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8d024913-b79f-4165-91f9-d70e1e4cfc0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:21.245963 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2aa1e786-ae2b-4221-85c9-0f22976d4f88 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1204 microversion: 2.1 time: 0.112709 Feb 21 02:30:21.246772 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 227/443] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:21 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1204 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:21.260170 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d024913-b79f-4165-91f9-d70e1e4cfc0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.260715 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d024913-b79f-4165-91f9-d70e1e4cfc0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.261553 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d024913-b79f-4165-91f9-d70e1e4cfc0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.262018 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8d024913-b79f-4165-91f9-d70e1e4cfc0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.360407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6f3f7ebe-0292-45f8-9ca1-70f759c11d8b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:21.360769 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6f3f7ebe-0292-45f8-9ca1-70f759c11d8b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:21.370559 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f3f7ebe-0292-45f8-9ca1-70f759c11d8b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.371857 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f3f7ebe-0292-45f8-9ca1-70f759c11d8b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.381379 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f3f7ebe-0292-45f8-9ca1-70f759c11d8b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.382270 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f3f7ebe-0292-45f8-9ca1-70f759c11d8b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.609081 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6f3f7ebe-0292-45f8-9ca1-70f759c11d8b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:21.620450 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6f3f7ebe-0292-45f8-9ca1-70f759c11d8b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.264974 Feb 21 02:30:21.621923 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 228/444] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:21 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:21.725949 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8d024913-b79f-4165-91f9-d70e1e4cfc0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:21.726876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b9352830-2da1-4771-958c-2dac7f71b6cb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:21.727528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b9352830-2da1-4771-958c-2dac7f71b6cb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:21.736909 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9352830-2da1-4771-958c-2dac7f71b6cb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.737529 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8d024913-b79f-4165-91f9-d70e1e4cfc0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1318 microversion: 2.1 time: 0.506674 Feb 21 02:30:21.737932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9352830-2da1-4771-958c-2dac7f71b6cb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.738685 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 217/445] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:21 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:21.738965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9352830-2da1-4771-958c-2dac7f71b6cb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:21.739404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9352830-2da1-4771-958c-2dac7f71b6cb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:21.803641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1698304808", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-72472954", "security_groups": [{"name": "tempest-secgroup-smoke-1444044047"}], "block_device_mapping_v2": [{"uuid": "88ff14b4-d829-4ab6-9eb8-08a5e6672ddf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c5e55e19-0047-4adf-9d84-20427890cdd2"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:21.910958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b9352830-2da1-4771-958c-2dac7f71b6cb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:21.919081 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b9352830-2da1-4771-958c-2dac7f71b6cb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.196333 Feb 21 02:30:21.919652 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 229/446] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:21 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:21.968812 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] validate_networks() for [('c5e55e19-0047-4adf-9d84-20427890cdd2', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:30:22.263131 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d5f90252-d622-4de4-b359-36b26a8d01ad tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:22.263729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d5f90252-d622-4de4-b359-36b26a8d01ad tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:22.270358 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d5f90252-d622-4de4-b359-36b26a8d01ad tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.270808 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d5f90252-d622-4de4-b359-36b26a8d01ad tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.271584 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d5f90252-d622-4de4-b359-36b26a8d01ad tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.272015 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d5f90252-d622-4de4-b359-36b26a8d01ad tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.435027 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d5f90252-d622-4de4-b359-36b26a8d01ad tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:22.443424 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d5f90252-d622-4de4-b359-36b26a8d01ad tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.183814 Feb 21 02:30:22.445613 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 230/447] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:22 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:22.638379 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6d0d4f17-4287-487c-b5db-510fd4a831c4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:22.639221 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6d0d4f17-4287-487c-b5db-510fd4a831c4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:22.645996 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d0d4f17-4287-487c-b5db-510fd4a831c4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.646440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d0d4f17-4287-487c-b5db-510fd4a831c4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.647215 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d0d4f17-4287-487c-b5db-510fd4a831c4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.647827 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d0d4f17-4287-487c-b5db-510fd4a831c4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.659107 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:30:22.660076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:30:22.660814 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:30:22.661436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:30:22.662098 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:30:22.671318 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.672050 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.672936 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.673504 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.693923 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for project 9d0c19115c1746f1956552777cc35baf. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:30:22.698014 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for user 9e81057507d24a2ca8f7b57eef422397 and project 9d0c19115c1746f1956552777cc35baf. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:30:22.766688 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:30:22.769710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88ff14b4-d829-4ab6-9eb8-08a5e6672ddf',volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:30:22.797282 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6d0d4f17-4287-487c-b5db-510fd4a831c4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:22.806053 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6d0d4f17-4287-487c-b5db-510fd4a831c4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.171167 Feb 21 02:30:22.806652 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 231/448] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:22 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:22.811054 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d8d67b33-0d4e-496f-bb3e-b97f21f318f2 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:22.811651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d8d67b33-0d4e-496f-bb3e-b97f21f318f2 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:22.825872 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d8d67b33-0d4e-496f-bb3e-b97f21f318f2 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.827031 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d8d67b33-0d4e-496f-bb3e-b97f21f318f2 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.828004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d8d67b33-0d4e-496f-bb3e-b97f21f318f2 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.829131 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d8d67b33-0d4e-496f-bb3e-b97f21f318f2 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.928583 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9431b2ad-0eb7-4e06-8eea-a6b5dcf22932 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.130126 Feb 21 02:30:22.929310 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 218/449] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:30:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:30:22.937092 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9d478e93-5fa5-401e-b50b-5ff93a8fe35b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:22.937816 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9d478e93-5fa5-401e-b50b-5ff93a8fe35b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:22.951647 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9d478e93-5fa5-401e-b50b-5ff93a8fe35b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.952154 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9d478e93-5fa5-401e-b50b-5ff93a8fe35b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.954431 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9d478e93-5fa5-401e-b50b-5ff93a8fe35b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:22.954956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9d478e93-5fa5-401e-b50b-5ff93a8fe35b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:22.995164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d8d67b33-0d4e-496f-bb3e-b97f21f318f2 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:23.003309 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d8d67b33-0d4e-496f-bb3e-b97f21f318f2 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1507 microversion: 2.1 time: 0.195656 Feb 21 02:30:23.014200 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 232/450] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:22 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:23.021496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7c4b5cf6-5622-4635-a726-4f835baf373b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:23.022432 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7c4b5cf6-5622-4635-a726-4f835baf373b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:23.094651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7c4b5cf6-5622-4635-a726-4f835baf373b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:23.103843 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7c4b5cf6-5622-4635-a726-4f835baf373b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1093 microversion: 2.1 time: 0.089031 Feb 21 02:30:23.104427 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 233/451] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:23 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:23.461529 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-617f9a01-7b18-4f02-bb2c-d6763d2a3000 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:23.462917 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-617f9a01-7b18-4f02-bb2c-d6763d2a3000 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:23.476476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-617f9a01-7b18-4f02-bb2c-d6763d2a3000 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:23.477665 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-617f9a01-7b18-4f02-bb2c-d6763d2a3000 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:23.479668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-617f9a01-7b18-4f02-bb2c-d6763d2a3000 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:23.480389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-617f9a01-7b18-4f02-bb2c-d6763d2a3000 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:23.614797 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9d478e93-5fa5-401e-b50b-5ff93a8fe35b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:23.637848 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9d478e93-5fa5-401e-b50b-5ff93a8fe35b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.704225 Feb 21 02:30:23.639964 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 219/452] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:22 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:23.719787 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-8c546540-ce66-4313-8bf4-7793b60a89fe req-b3b700a3-b3e5-4a54-b2e6-b201efb9ea0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28fd287f-356c-4485-ba82-bbe3da3cf5ba", "tag": "212cff7d-b04b-4efb-be92-6dd1bd6ec779"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:23.724367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:23.724367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:30:23.735263 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-8c546540-ce66-4313-8bf4-7793b60a89fe req-b3b700a3-b3e5-4a54-b2e6-b201efb9ea0d service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:23.736678 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-8c546540-ce66-4313-8bf4-7793b60a89fe req-b3b700a3-b3e5-4a54-b2e6-b201efb9ea0d service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:23.764564 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-617f9a01-7b18-4f02-bb2c-d6763d2a3000 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:23.769155 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-8c546540-ce66-4313-8bf4-7793b60a89fe req-b3b700a3-b3e5-4a54-b2e6-b201efb9ea0d service nova] Creating event network-changed:212cff7d-b04b-4efb-be92-6dd1bd6ec779 for instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba on hv-cinder-80447 Feb 21 02:30:23.773790 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-617f9a01-7b18-4f02-bb2c-d6763d2a3000 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.316363 Feb 21 02:30:23.779195 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 234/453] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:23 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:23.785333 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-8c546540-ce66-4313-8bf4-7793b60a89fe req-b3b700a3-b3e5-4a54-b2e6-b201efb9ea0d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093693 Feb 21 02:30:23.787058 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 220/454] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:23.825009 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8ee07798-d19d-4c5c-89af-0507f89f42e4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:23.825628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8ee07798-d19d-4c5c-89af-0507f89f42e4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:23.834663 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ee07798-d19d-4c5c-89af-0507f89f42e4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:23.835179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ee07798-d19d-4c5c-89af-0507f89f42e4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:23.836380 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ee07798-d19d-4c5c-89af-0507f89f42e4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:23.837024 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ee07798-d19d-4c5c-89af-0507f89f42e4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:23.992117 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8ee07798-d19d-4c5c-89af-0507f89f42e4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:23.999411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8ee07798-d19d-4c5c-89af-0507f89f42e4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1317 microversion: 2.1 time: 0.178574 Feb 21 02:30:23.999980 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 235/455] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:23 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:24.123117 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b3ed9cc9-284d-45c3-a6c8-5a44c2d70378 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:24.123803 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b3ed9cc9-284d-45c3-a6c8-5a44c2d70378 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:24.131103 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b3ed9cc9-284d-45c3-a6c8-5a44c2d70378 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:24.131548 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b3ed9cc9-284d-45c3-a6c8-5a44c2d70378 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:24.132493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b3ed9cc9-284d-45c3-a6c8-5a44c2d70378 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:24.133078 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b3ed9cc9-284d-45c3-a6c8-5a44c2d70378 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:24.207083 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b3ed9cc9-284d-45c3-a6c8-5a44c2d70378 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:24.214819 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b3ed9cc9-284d-45c3-a6c8-5a44c2d70378 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1191 microversion: 2.1 time: 0.095708 Feb 21 02:30:24.215379 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 221/456] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:24 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:24.659949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1dccdca3-ef8c-47a7-8092-ac0a3685421d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:24.661434 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1dccdca3-ef8c-47a7-8092-ac0a3685421d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:24.669609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1dccdca3-ef8c-47a7-8092-ac0a3685421d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:24.670268 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1dccdca3-ef8c-47a7-8092-ac0a3685421d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:24.671210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1dccdca3-ef8c-47a7-8092-ac0a3685421d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:24.671792 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1dccdca3-ef8c-47a7-8092-ac0a3685421d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:24.796171 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6942df67-2d47-4631-8e12-9f3363e0ed30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:24.796960 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6942df67-2d47-4631-8e12-9f3363e0ed30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:24.804179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6942df67-2d47-4631-8e12-9f3363e0ed30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:24.804658 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6942df67-2d47-4631-8e12-9f3363e0ed30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:24.805999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6942df67-2d47-4631-8e12-9f3363e0ed30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:24.806794 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6942df67-2d47-4631-8e12-9f3363e0ed30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:24.855155 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1dccdca3-ef8c-47a7-8092-ac0a3685421d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:24.869883 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1dccdca3-ef8c-47a7-8092-ac0a3685421d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.216565 Feb 21 02:30:24.871138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 236/457] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:24 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:25.021496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2c657609-c0e7-42b2-b67f-f732ef504ce6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:25.023356 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2c657609-c0e7-42b2-b67f-f732ef504ce6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:25.034036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2c657609-c0e7-42b2-b67f-f732ef504ce6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:25.034981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2c657609-c0e7-42b2-b67f-f732ef504ce6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:25.036183 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2c657609-c0e7-42b2-b67f-f732ef504ce6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:25.037197 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2c657609-c0e7-42b2-b67f-f732ef504ce6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:25.213237 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2c657609-c0e7-42b2-b67f-f732ef504ce6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:25.222360 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2c657609-c0e7-42b2-b67f-f732ef504ce6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1507 microversion: 2.1 time: 0.207693 Feb 21 02:30:25.223010 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 237/458] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:25 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:25.239151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4b51195f-43f3-46ed-be3e-a2a7902223ff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:25.239921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4b51195f-43f3-46ed-be3e-a2a7902223ff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:25.246404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4b51195f-43f3-46ed-be3e-a2a7902223ff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:25.246852 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4b51195f-43f3-46ed-be3e-a2a7902223ff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:25.247645 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4b51195f-43f3-46ed-be3e-a2a7902223ff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:25.248083 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4b51195f-43f3-46ed-be3e-a2a7902223ff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:25.258551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6942df67-2d47-4631-8e12-9f3363e0ed30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:25.269484 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6942df67-2d47-4631-8e12-9f3363e0ed30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.476952 Feb 21 02:30:25.270870 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 222/459] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:24 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:25.337199 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4b51195f-43f3-46ed-be3e-a2a7902223ff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:25.356509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4b51195f-43f3-46ed-be3e-a2a7902223ff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1209 microversion: 2.1 time: 0.125169 Feb 21 02:30:25.357692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 238/460] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:25 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1209 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:25.887716 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5225d4e1-0b57-457a-b433-e44ba068de3b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:25.888319 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5225d4e1-0b57-457a-b433-e44ba068de3b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:25.894535 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5225d4e1-0b57-457a-b433-e44ba068de3b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:25.894985 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5225d4e1-0b57-457a-b433-e44ba068de3b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:25.895766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5225d4e1-0b57-457a-b433-e44ba068de3b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:25.896198 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5225d4e1-0b57-457a-b433-e44ba068de3b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:26.122017 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5225d4e1-0b57-457a-b433-e44ba068de3b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:26.132552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5225d4e1-0b57-457a-b433-e44ba068de3b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.248201 Feb 21 02:30:26.134798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 223/461] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:25 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:26.286972 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b4789dd1-ebfb-4108-8a2e-235f2940d5b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:26.287575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b4789dd1-ebfb-4108-8a2e-235f2940d5b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:26.297212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b4789dd1-ebfb-4108-8a2e-235f2940d5b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:26.298033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b4789dd1-ebfb-4108-8a2e-235f2940d5b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:26.299160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b4789dd1-ebfb-4108-8a2e-235f2940d5b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:26.299810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b4789dd1-ebfb-4108-8a2e-235f2940d5b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:26.377508 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2a23bcd9-d2b7-4c30-a351-555f0cf843e7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:26.378395 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2a23bcd9-d2b7-4c30-a351-555f0cf843e7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:26.386158 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2a23bcd9-d2b7-4c30-a351-555f0cf843e7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:26.386941 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2a23bcd9-d2b7-4c30-a351-555f0cf843e7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:26.388409 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2a23bcd9-d2b7-4c30-a351-555f0cf843e7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:26.389089 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2a23bcd9-d2b7-4c30-a351-555f0cf843e7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:26.573736 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b4789dd1-ebfb-4108-8a2e-235f2940d5b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:26.585175 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b4789dd1-ebfb-4108-8a2e-235f2940d5b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.301993 Feb 21 02:30:26.601889 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 239/462] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:26 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:26.608876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-1ecf4e5b-3d30-4c08-8891-6f9b1d37a799 req-1264d285-c29c-4ac6-b340-0c7b63b59062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e88ba1-3efc-43bb-a9fe-cea1161d320e", "tag": "a0143c80-ec51-407d-bae9-5a6f62cc1615"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:26.612393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:26.612393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:30:26.626129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-1ecf4e5b-3d30-4c08-8891-6f9b1d37a799 req-1264d285-c29c-4ac6-b340-0c7b63b59062 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:26.626705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-1ecf4e5b-3d30-4c08-8891-6f9b1d37a799 req-1264d285-c29c-4ac6-b340-0c7b63b59062 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:26.665407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-1ecf4e5b-3d30-4c08-8891-6f9b1d37a799 req-1264d285-c29c-4ac6-b340-0c7b63b59062 service nova] Creating event network-changed:a0143c80-ec51-407d-bae9-5a6f62cc1615 for instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e on hv-cinder-80447 Feb 21 02:30:26.671709 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-1ecf4e5b-3d30-4c08-8891-6f9b1d37a799 req-1264d285-c29c-4ac6-b340-0c7b63b59062 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068037 Feb 21 02:30:26.672646 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 240/463] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:26.764663 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2a23bcd9-d2b7-4c30-a351-555f0cf843e7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:26.778778 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2a23bcd9-d2b7-4c30-a351-555f0cf843e7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.406519 Feb 21 02:30:26.780115 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 224/464] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:26 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:27.151968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d6bf20b5-0494-4a64-b3c4-3a74963eef96 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:27.152821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d6bf20b5-0494-4a64-b3c4-3a74963eef96 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:27.159600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6bf20b5-0494-4a64-b3c4-3a74963eef96 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:27.160116 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6bf20b5-0494-4a64-b3c4-3a74963eef96 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:27.160978 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6bf20b5-0494-4a64-b3c4-3a74963eef96 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:27.161472 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6bf20b5-0494-4a64-b3c4-3a74963eef96 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:27.308788 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d6bf20b5-0494-4a64-b3c4-3a74963eef96 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:27.322871 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d6bf20b5-0494-4a64-b3c4-3a74963eef96 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.174801 Feb 21 02:30:27.325739 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 241/465] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:27 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:27.601722 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0d23d6c2-c633-4136-a6d0-d08b6bc60fef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:27.602249 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0d23d6c2-c633-4136-a6d0-d08b6bc60fef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:27.608495 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0d23d6c2-c633-4136-a6d0-d08b6bc60fef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:27.608951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0d23d6c2-c633-4136-a6d0-d08b6bc60fef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:27.610207 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0d23d6c2-c633-4136-a6d0-d08b6bc60fef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:27.611384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0d23d6c2-c633-4136-a6d0-d08b6bc60fef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:27.714086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4ef42e21-6f98-4bf8-a9f9-9620ac7111f5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85d6c9a6-1d28-4a0d-9147-5ae25621500b"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:27.715403 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4ef42e21-6f98-4bf8-a9f9-9620ac7111f5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:27.722077 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4ef42e21-6f98-4bf8-a9f9-9620ac7111f5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:27.722526 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4ef42e21-6f98-4bf8-a9f9-9620ac7111f5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:27.723471 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4ef42e21-6f98-4bf8-a9f9-9620ac7111f5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:27.724071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4ef42e21-6f98-4bf8-a9f9-9620ac7111f5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:27.762632 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0d23d6c2-c633-4136-a6d0-d08b6bc60fef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:27.770074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0d23d6c2-c633-4136-a6d0-d08b6bc60fef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.172246 Feb 21 02:30:27.770588 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 225/466] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:27 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:27.806615 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-37938e7f-6880-4669-a8f8-70f07d993518 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:27.808160 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-37938e7f-6880-4669-a8f8-70f07d993518 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:27.814648 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37938e7f-6880-4669-a8f8-70f07d993518 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:27.815333 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37938e7f-6880-4669-a8f8-70f07d993518 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:27.816551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37938e7f-6880-4669-a8f8-70f07d993518 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:27.817243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37938e7f-6880-4669-a8f8-70f07d993518 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:28.008427 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-37938e7f-6880-4669-a8f8-70f07d993518 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:28.023736 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-37938e7f-6880-4669-a8f8-70f07d993518 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.222500 Feb 21 02:30:28.024657 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 226/467] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:27 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:28.040151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4ef42e21-6f98-4bf8-a9f9-9620ac7111f5 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "POST /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329521 Feb 21 02:30:28.041057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 242/468] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:30:27 2022] POST /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:28.342087 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3bfc554a-e30f-436d-b0e3-298dd32b8a82 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:28.342600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3bfc554a-e30f-436d-b0e3-298dd32b8a82 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:28.348799 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3bfc554a-e30f-436d-b0e3-298dd32b8a82 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:28.349239 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3bfc554a-e30f-436d-b0e3-298dd32b8a82 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:28.350047 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3bfc554a-e30f-436d-b0e3-298dd32b8a82 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:28.350492 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3bfc554a-e30f-436d-b0e3-298dd32b8a82 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:28.487887 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3bfc554a-e30f-436d-b0e3-298dd32b8a82 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:28.496162 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3bfc554a-e30f-436d-b0e3-298dd32b8a82 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.157595 Feb 21 02:30:28.496897 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 227/469] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:28 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:28.787696 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1784b44b-b4d1-4ad5-a3d7-efe17301b223 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:28.788429 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1784b44b-b4d1-4ad5-a3d7-efe17301b223 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:28.794519 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1784b44b-b4d1-4ad5-a3d7-efe17301b223 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:28.794968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1784b44b-b4d1-4ad5-a3d7-efe17301b223 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:28.795744 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1784b44b-b4d1-4ad5-a3d7-efe17301b223 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:28.796179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1784b44b-b4d1-4ad5-a3d7-efe17301b223 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:28.958457 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1784b44b-b4d1-4ad5-a3d7-efe17301b223 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:28.965895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1784b44b-b4d1-4ad5-a3d7-efe17301b223 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.182601 Feb 21 02:30:28.966475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 243/470] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:28 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:29.040039 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6111999b-a159-4914-bcff-f9542b6f6347 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:29.040647 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6111999b-a159-4914-bcff-f9542b6f6347 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:29.047067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6111999b-a159-4914-bcff-f9542b6f6347 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:29.047522 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6111999b-a159-4914-bcff-f9542b6f6347 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:29.048881 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6111999b-a159-4914-bcff-f9542b6f6347 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:29.049325 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6111999b-a159-4914-bcff-f9542b6f6347 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:29.194034 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6111999b-a159-4914-bcff-f9542b6f6347 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:29.201634 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6111999b-a159-4914-bcff-f9542b6f6347 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.165233 Feb 21 02:30:29.202394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 228/471] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:29 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:29.515426 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-99f6e4f8-ca87-41de-9f7a-0c2f9c807afd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:29.515958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-99f6e4f8-ca87-41de-9f7a-0c2f9c807afd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:29.523110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99f6e4f8-ca87-41de-9f7a-0c2f9c807afd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:29.523559 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99f6e4f8-ca87-41de-9f7a-0c2f9c807afd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:29.524337 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99f6e4f8-ca87-41de-9f7a-0c2f9c807afd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:29.524775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99f6e4f8-ca87-41de-9f7a-0c2f9c807afd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:29.662946 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-99f6e4f8-ca87-41de-9f7a-0c2f9c807afd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:29.670646 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-99f6e4f8-ca87-41de-9f7a-0c2f9c807afd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.158931 Feb 21 02:30:29.671216 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 244/472] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:29 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:29.983552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a065fe48-401b-42b4-bdb2-bc98eb512fe1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:29.984153 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a065fe48-401b-42b4-bdb2-bc98eb512fe1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:29.991306 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a065fe48-401b-42b4-bdb2-bc98eb512fe1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:29.991684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a065fe48-401b-42b4-bdb2-bc98eb512fe1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:29.992458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a065fe48-401b-42b4-bdb2-bc98eb512fe1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:29.992896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a065fe48-401b-42b4-bdb2-bc98eb512fe1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:30.130937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a065fe48-401b-42b4-bdb2-bc98eb512fe1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:30.138490 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a065fe48-401b-42b4-bdb2-bc98eb512fe1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.158494 Feb 21 02:30:30.139263 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 229/473] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:29 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:30.218880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-de6b8b12-894d-455c-aa82-ae9f9eb2ed75 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:30.219485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-de6b8b12-894d-455c-aa82-ae9f9eb2ed75 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:30.225865 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-de6b8b12-894d-455c-aa82-ae9f9eb2ed75 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:30.226311 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-de6b8b12-894d-455c-aa82-ae9f9eb2ed75 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:30.227076 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-de6b8b12-894d-455c-aa82-ae9f9eb2ed75 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:30.227505 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-de6b8b12-894d-455c-aa82-ae9f9eb2ed75 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:30.369057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-de6b8b12-894d-455c-aa82-ae9f9eb2ed75 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:30.376933 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-de6b8b12-894d-455c-aa82-ae9f9eb2ed75 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.161000 Feb 21 02:30:30.377535 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 245/474] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:30 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:30.687383 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-45ae1f74-a1ab-4f3e-846c-f0c540c91eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:30.687991 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-45ae1f74-a1ab-4f3e-846c-f0c540c91eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:30.694074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-45ae1f74-a1ab-4f3e-846c-f0c540c91eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:30.694520 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-45ae1f74-a1ab-4f3e-846c-f0c540c91eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:30.695323 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-45ae1f74-a1ab-4f3e-846c-f0c540c91eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:30.695781 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-45ae1f74-a1ab-4f3e-846c-f0c540c91eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:30.833678 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-45ae1f74-a1ab-4f3e-846c-f0c540c91eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:30.842094 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-45ae1f74-a1ab-4f3e-846c-f0c540c91eef tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.158281 Feb 21 02:30:30.842660 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 230/475] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:30 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:31.155856 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-55cd1922-36e9-40a3-b91e-fad1b52649fd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:31.156487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-55cd1922-36e9-40a3-b91e-fad1b52649fd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:31.163341 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-55cd1922-36e9-40a3-b91e-fad1b52649fd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:31.163788 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-55cd1922-36e9-40a3-b91e-fad1b52649fd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:31.164586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-55cd1922-36e9-40a3-b91e-fad1b52649fd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:31.165017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-55cd1922-36e9-40a3-b91e-fad1b52649fd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:31.298846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-55cd1922-36e9-40a3-b91e-fad1b52649fd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:31.306134 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-55cd1922-36e9-40a3-b91e-fad1b52649fd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.154032 Feb 21 02:30:31.306710 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 246/476] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:31 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:31.393326 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2accb96b-1e48-464a-a8df-4fe0030019ba tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:31.393965 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2accb96b-1e48-464a-a8df-4fe0030019ba tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:31.401137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2accb96b-1e48-464a-a8df-4fe0030019ba tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:31.401590 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2accb96b-1e48-464a-a8df-4fe0030019ba tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:31.402402 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2accb96b-1e48-464a-a8df-4fe0030019ba tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:31.402836 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2accb96b-1e48-464a-a8df-4fe0030019ba tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:31.541103 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2accb96b-1e48-464a-a8df-4fe0030019ba tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:31.548220 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2accb96b-1e48-464a-a8df-4fe0030019ba tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.158546 Feb 21 02:30:31.548778 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 231/477] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:31 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:31.859839 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ce641a0d-7544-4977-bac5-28d6b590b9a7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:31.860392 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ce641a0d-7544-4977-bac5-28d6b590b9a7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:31.866774 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ce641a0d-7544-4977-bac5-28d6b590b9a7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:31.867214 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ce641a0d-7544-4977-bac5-28d6b590b9a7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:31.867971 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ce641a0d-7544-4977-bac5-28d6b590b9a7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:31.868399 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ce641a0d-7544-4977-bac5-28d6b590b9a7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:32.012989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ce641a0d-7544-4977-bac5-28d6b590b9a7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:32.022370 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ce641a0d-7544-4977-bac5-28d6b590b9a7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.166507 Feb 21 02:30:32.022948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 247/478] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:31 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:32.322371 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0bb3107c-5eba-44b5-9061-9430ba0f01c8 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:32.322972 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0bb3107c-5eba-44b5-9061-9430ba0f01c8 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:32.328740 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0bb3107c-5eba-44b5-9061-9430ba0f01c8 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:32.329185 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0bb3107c-5eba-44b5-9061-9430ba0f01c8 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:32.329993 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0bb3107c-5eba-44b5-9061-9430ba0f01c8 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:32.330427 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0bb3107c-5eba-44b5-9061-9430ba0f01c8 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:32.474638 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0bb3107c-5eba-44b5-9061-9430ba0f01c8 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:32.482308 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0bb3107c-5eba-44b5-9061-9430ba0f01c8 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.163345 Feb 21 02:30:32.482765 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 232/479] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:32 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:32.565021 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d65be3d7-d48f-4415-8765-2255a1699e9d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:32.565630 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d65be3d7-d48f-4415-8765-2255a1699e9d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:32.571946 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d65be3d7-d48f-4415-8765-2255a1699e9d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:32.572391 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d65be3d7-d48f-4415-8765-2255a1699e9d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:32.573163 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d65be3d7-d48f-4415-8765-2255a1699e9d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:32.573598 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d65be3d7-d48f-4415-8765-2255a1699e9d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:32.715535 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d65be3d7-d48f-4415-8765-2255a1699e9d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:32.723124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d65be3d7-d48f-4415-8765-2255a1699e9d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.161800 Feb 21 02:30:32.723702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 248/480] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:32 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:33.039251 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-080e8dc5-b883-42ae-80de-6b603bb59731 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:33.039945 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-080e8dc5-b883-42ae-80de-6b603bb59731 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:33.046072 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-080e8dc5-b883-42ae-80de-6b603bb59731 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:33.046521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-080e8dc5-b883-42ae-80de-6b603bb59731 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:33.047303 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-080e8dc5-b883-42ae-80de-6b603bb59731 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:33.047734 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-080e8dc5-b883-42ae-80de-6b603bb59731 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:33.189519 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-080e8dc5-b883-42ae-80de-6b603bb59731 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:33.198361 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-080e8dc5-b883-42ae-80de-6b603bb59731 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.162697 Feb 21 02:30:33.202585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 233/481] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:33 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:33.499405 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e457adc6-f2ab-4a91-9d72-17dab21f7b7c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:33.500004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e457adc6-f2ab-4a91-9d72-17dab21f7b7c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:33.506271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e457adc6-f2ab-4a91-9d72-17dab21f7b7c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:33.506707 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e457adc6-f2ab-4a91-9d72-17dab21f7b7c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:33.507496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e457adc6-f2ab-4a91-9d72-17dab21f7b7c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:33.507924 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e457adc6-f2ab-4a91-9d72-17dab21f7b7c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:33.652387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e457adc6-f2ab-4a91-9d72-17dab21f7b7c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:33.661576 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e457adc6-f2ab-4a91-9d72-17dab21f7b7c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.165743 Feb 21 02:30:33.662202 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 249/482] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:33 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:33.740340 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d76dd099-c5ac-457b-b7d4-a6fc451fbce7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:33.740945 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d76dd099-c5ac-457b-b7d4-a6fc451fbce7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:33.747162 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d76dd099-c5ac-457b-b7d4-a6fc451fbce7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:33.747655 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d76dd099-c5ac-457b-b7d4-a6fc451fbce7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:33.748560 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d76dd099-c5ac-457b-b7d4-a6fc451fbce7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:33.748995 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d76dd099-c5ac-457b-b7d4-a6fc451fbce7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:33.887970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d76dd099-c5ac-457b-b7d4-a6fc451fbce7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:33.899804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d76dd099-c5ac-457b-b7d4-a6fc451fbce7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.163831 Feb 21 02:30:33.900573 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 234/483] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:33 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:34.215069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5305beb3-628d-4d7c-8c56-c3fc97c40179 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:34.215673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5305beb3-628d-4d7c-8c56-c3fc97c40179 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:34.221414 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5305beb3-628d-4d7c-8c56-c3fc97c40179 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:34.222142 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5305beb3-628d-4d7c-8c56-c3fc97c40179 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:34.223181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5305beb3-628d-4d7c-8c56-c3fc97c40179 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:34.223620 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5305beb3-628d-4d7c-8c56-c3fc97c40179 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:34.362694 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5305beb3-628d-4d7c-8c56-c3fc97c40179 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:34.370473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5305beb3-628d-4d7c-8c56-c3fc97c40179 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.158920 Feb 21 02:30:34.371049 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 250/484] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:34 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:34.678958 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-db016262-6c73-4fa6-b6a9-7ebdfbf343e3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:34.679497 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-db016262-6c73-4fa6-b6a9-7ebdfbf343e3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:34.685389 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db016262-6c73-4fa6-b6a9-7ebdfbf343e3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:34.685870 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db016262-6c73-4fa6-b6a9-7ebdfbf343e3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:34.686630 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db016262-6c73-4fa6-b6a9-7ebdfbf343e3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:34.687053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db016262-6c73-4fa6-b6a9-7ebdfbf343e3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:34.827407 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-db016262-6c73-4fa6-b6a9-7ebdfbf343e3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:34.835049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-db016262-6c73-4fa6-b6a9-7ebdfbf343e3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.160362 Feb 21 02:30:34.835648 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 235/485] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:34 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:34.916424 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-04f32a5a-a933-4ffe-b6dc-12f68158f708 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:34.917028 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-04f32a5a-a933-4ffe-b6dc-12f68158f708 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:34.923403 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04f32a5a-a933-4ffe-b6dc-12f68158f708 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:34.923874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04f32a5a-a933-4ffe-b6dc-12f68158f708 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:34.925279 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04f32a5a-a933-4ffe-b6dc-12f68158f708 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:34.926054 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04f32a5a-a933-4ffe-b6dc-12f68158f708 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:35.065957 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-04f32a5a-a933-4ffe-b6dc-12f68158f708 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:35.073017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-04f32a5a-a933-4ffe-b6dc-12f68158f708 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.160331 Feb 21 02:30:35.073575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 251/486] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:34 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:35.390627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7be2ad35-45e0-480e-8288-bf579e42782e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:35.391234 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7be2ad35-45e0-480e-8288-bf579e42782e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:35.397820 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7be2ad35-45e0-480e-8288-bf579e42782e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:35.398266 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7be2ad35-45e0-480e-8288-bf579e42782e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:35.399097 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7be2ad35-45e0-480e-8288-bf579e42782e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:35.399546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7be2ad35-45e0-480e-8288-bf579e42782e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:35.536629 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7be2ad35-45e0-480e-8288-bf579e42782e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:35.544540 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7be2ad35-45e0-480e-8288-bf579e42782e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.160183 Feb 21 02:30:35.545161 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 236/487] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:35 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:35.851250 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-750898e4-3573-4f95-aa79-af7c2f359119 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:35.851818 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-750898e4-3573-4f95-aa79-af7c2f359119 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:35.857728 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-750898e4-3573-4f95-aa79-af7c2f359119 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:35.858181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-750898e4-3573-4f95-aa79-af7c2f359119 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:35.858959 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-750898e4-3573-4f95-aa79-af7c2f359119 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:35.859395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-750898e4-3573-4f95-aa79-af7c2f359119 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:35.996545 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-750898e4-3573-4f95-aa79-af7c2f359119 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:36.004375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-750898e4-3573-4f95-aa79-af7c2f359119 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.156892 Feb 21 02:30:36.004932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 252/488] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:35 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:36.088748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b4870f80-8e8f-4d9b-99b9-98a92860fcdf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:36.089352 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b4870f80-8e8f-4d9b-99b9-98a92860fcdf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:36.095584 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b4870f80-8e8f-4d9b-99b9-98a92860fcdf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:36.096027 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b4870f80-8e8f-4d9b-99b9-98a92860fcdf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:36.097168 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b4870f80-8e8f-4d9b-99b9-98a92860fcdf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:36.097527 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b4870f80-8e8f-4d9b-99b9-98a92860fcdf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:36.475138 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b4870f80-8e8f-4d9b-99b9-98a92860fcdf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:36.483101 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b4870f80-8e8f-4d9b-99b9-98a92860fcdf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.397958 Feb 21 02:30:36.483754 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 237/489] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:36 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:36.561854 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7cad8a29-51b1-4cb4-a935-39d10e010d1c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:36.562467 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7cad8a29-51b1-4cb4-a935-39d10e010d1c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:36.568399 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7cad8a29-51b1-4cb4-a935-39d10e010d1c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:36.568855 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7cad8a29-51b1-4cb4-a935-39d10e010d1c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:36.569659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7cad8a29-51b1-4cb4-a935-39d10e010d1c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:36.570101 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7cad8a29-51b1-4cb4-a935-39d10e010d1c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:36.679602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-62112960-bcf6-4508-9838-d62d8525796a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:36.680093 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-62112960-bcf6-4508-9838-d62d8525796a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:36.685767 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62112960-bcf6-4508-9838-d62d8525796a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:36.686218 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62112960-bcf6-4508-9838-d62d8525796a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:36.686987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62112960-bcf6-4508-9838-d62d8525796a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:36.687418 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-62112960-bcf6-4508-9838-d62d8525796a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:36.714881 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7cad8a29-51b1-4cb4-a935-39d10e010d1c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:36.723645 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7cad8a29-51b1-4cb4-a935-39d10e010d1c tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.165251 Feb 21 02:30:36.724154 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 253/490] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:36 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:36.767013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-62112960-bcf6-4508-9838-d62d8525796a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'services' on Instance uuid 15be83cb-8289-45b8-950c-8677b8b55d6a {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:36.835850 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-62112960-bcf6-4508-9838-d62d8525796a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "DELETE /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments/85d6c9a6-1d28-4a0d-9147-5ae25621500b" status: 202 len: 0 microversion: 2.1 time: 0.161089 Feb 21 02:30:36.836509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 238/491] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:30:36 2022] DELETE /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments/85d6c9a6-1d28-4a0d-9147-5ae25621500b => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:30:36.845305 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dff3fcdf-21b5-4b60-8560-92c0dad55d86 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:36.846432 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dff3fcdf-21b5-4b60-8560-92c0dad55d86 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:36.854003 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dff3fcdf-21b5-4b60-8560-92c0dad55d86 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:36.854545 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dff3fcdf-21b5-4b60-8560-92c0dad55d86 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:36.855434 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dff3fcdf-21b5-4b60-8560-92c0dad55d86 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:36.855967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dff3fcdf-21b5-4b60-8560-92c0dad55d86 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:36.888486 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dff3fcdf-21b5-4b60-8560-92c0dad55d86 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047679 Feb 21 02:30:36.889251 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 254/492] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:36 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:30:37.021223 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e8ec51b9-5007-4b2f-b0d9-29fc6ddf7c8e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:37.021894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e8ec51b9-5007-4b2f-b0d9-29fc6ddf7c8e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:37.027951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e8ec51b9-5007-4b2f-b0d9-29fc6ddf7c8e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:37.028393 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e8ec51b9-5007-4b2f-b0d9-29fc6ddf7c8e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:37.029163 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e8ec51b9-5007-4b2f-b0d9-29fc6ddf7c8e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:37.029593 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e8ec51b9-5007-4b2f-b0d9-29fc6ddf7c8e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:37.169719 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e8ec51b9-5007-4b2f-b0d9-29fc6ddf7c8e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:37.177627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e8ec51b9-5007-4b2f-b0d9-29fc6ddf7c8e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.160463 Feb 21 02:30:37.178211 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 239/493] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:37 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:37.501164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-47ee9bca-4fe9-410f-aa1e-c0e27a2bae4e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:37.501817 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-47ee9bca-4fe9-410f-aa1e-c0e27a2bae4e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:37.508069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-47ee9bca-4fe9-410f-aa1e-c0e27a2bae4e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:37.508510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-47ee9bca-4fe9-410f-aa1e-c0e27a2bae4e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:37.509277 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-47ee9bca-4fe9-410f-aa1e-c0e27a2bae4e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:37.509746 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-47ee9bca-4fe9-410f-aa1e-c0e27a2bae4e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:37.653282 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-47ee9bca-4fe9-410f-aa1e-c0e27a2bae4e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:37.661440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-47ee9bca-4fe9-410f-aa1e-c0e27a2bae4e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.163853 Feb 21 02:30:37.662045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 255/494] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:37 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:37.740330 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3d42d0a8-e403-41be-986e-adbfd8abf9d4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:37.740959 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3d42d0a8-e403-41be-986e-adbfd8abf9d4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:37.746830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3d42d0a8-e403-41be-986e-adbfd8abf9d4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:37.747274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3d42d0a8-e403-41be-986e-adbfd8abf9d4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:37.748042 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3d42d0a8-e403-41be-986e-adbfd8abf9d4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:37.748480 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3d42d0a8-e403-41be-986e-adbfd8abf9d4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:37.901074 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-74aefedb-70a5-4e1e-970d-84164f669e8a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:37.902252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-74aefedb-70a5-4e1e-970d-84164f669e8a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:37.909071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-74aefedb-70a5-4e1e-970d-84164f669e8a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:37.909576 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-74aefedb-70a5-4e1e-970d-84164f669e8a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:37.910395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-74aefedb-70a5-4e1e-970d-84164f669e8a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:37.910860 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-74aefedb-70a5-4e1e-970d-84164f669e8a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:37.940905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-74aefedb-70a5-4e1e-970d-84164f669e8a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Feb 21 02:30:37.941705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 256/495] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:37 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:30:37.976012 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3d42d0a8-e403-41be-986e-adbfd8abf9d4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:37.983612 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3d42d0a8-e403-41be-986e-adbfd8abf9d4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.247018 Feb 21 02:30:37.984179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 240/496] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:37 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:38.194041 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b6917555-b108-4f1e-955b-f00278e16bee tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:38.194655 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b6917555-b108-4f1e-955b-f00278e16bee tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:38.200934 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b6917555-b108-4f1e-955b-f00278e16bee tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:38.201392 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b6917555-b108-4f1e-955b-f00278e16bee tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:38.202208 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b6917555-b108-4f1e-955b-f00278e16bee tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:38.202959 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b6917555-b108-4f1e-955b-f00278e16bee tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:38.366379 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b6917555-b108-4f1e-955b-f00278e16bee tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:38.373949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b6917555-b108-4f1e-955b-f00278e16bee tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.183505 Feb 21 02:30:38.374724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 257/497] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:38 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:38.677893 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ec1d1a82-0a05-495f-b5ac-39e8c909162b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:38.678504 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ec1d1a82-0a05-495f-b5ac-39e8c909162b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:38.684820 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ec1d1a82-0a05-495f-b5ac-39e8c909162b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:38.685269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ec1d1a82-0a05-495f-b5ac-39e8c909162b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:38.686081 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ec1d1a82-0a05-495f-b5ac-39e8c909162b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:38.686518 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ec1d1a82-0a05-495f-b5ac-39e8c909162b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:38.827314 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ec1d1a82-0a05-495f-b5ac-39e8c909162b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:38.834623 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ec1d1a82-0a05-495f-b5ac-39e8c909162b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.160394 Feb 21 02:30:38.835203 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 241/498] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:38 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:38.952421 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-70a9e7bc-4382-4525-8cbd-08c3074f0d3f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:38.953280 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-70a9e7bc-4382-4525-8cbd-08c3074f0d3f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:38.960039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-70a9e7bc-4382-4525-8cbd-08c3074f0d3f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:38.960482 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-70a9e7bc-4382-4525-8cbd-08c3074f0d3f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:38.961241 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-70a9e7bc-4382-4525-8cbd-08c3074f0d3f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:38.961695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-70a9e7bc-4382-4525-8cbd-08c3074f0d3f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:38.992057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-70a9e7bc-4382-4525-8cbd-08c3074f0d3f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043384 Feb 21 02:30:38.993395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 258/499] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:38 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 02:30:39.004539 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c8fc6448-73fa-4c15-acae-2cb38fba6c9f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:39.005260 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c8fc6448-73fa-4c15-acae-2cb38fba6c9f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:39.035575 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c8fc6448-73fa-4c15-acae-2cb38fba6c9f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:39.036032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c8fc6448-73fa-4c15-acae-2cb38fba6c9f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:39.036804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c8fc6448-73fa-4c15-acae-2cb38fba6c9f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:39.037237 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c8fc6448-73fa-4c15-acae-2cb38fba6c9f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:39.219079 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c8fc6448-73fa-4c15-acae-2cb38fba6c9f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:39.227576 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c8fc6448-73fa-4c15-acae-2cb38fba6c9f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.228678 Feb 21 02:30:39.228323 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 242/500] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:38 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:39.389978 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-bd49d2ab-e3c8-438a-ba1c-bf8cf5459fe9 req-81df4edd-0bdb-451d-822e-c2eca9f0ebc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fd287f-356c-4485-ba82-bbe3da3cf5ba", "name": "network-vif-plugged", "status": "completed", "tag": "212cff7d-b04b-4efb-be92-6dd1bd6ec779"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:39.391757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-55630cbc-9a5e-4a34-aa7a-7e25882b5a9e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:39.392557 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-55630cbc-9a5e-4a34-aa7a-7e25882b5a9e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:39.392683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:39.392683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:30:39.414654 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55630cbc-9a5e-4a34-aa7a-7e25882b5a9e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:39.415233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55630cbc-9a5e-4a34-aa7a-7e25882b5a9e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:39.416047 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55630cbc-9a5e-4a34-aa7a-7e25882b5a9e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:39.416485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55630cbc-9a5e-4a34-aa7a-7e25882b5a9e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:39.418104 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-bd49d2ab-e3c8-438a-ba1c-bf8cf5459fe9 req-81df4edd-0bdb-451d-822e-c2eca9f0ebc0 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:39.418570 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-bd49d2ab-e3c8-438a-ba1c-bf8cf5459fe9 req-81df4edd-0bdb-451d-822e-c2eca9f0ebc0 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:39.438100 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-bd49d2ab-e3c8-438a-ba1c-bf8cf5459fe9 req-81df4edd-0bdb-451d-822e-c2eca9f0ebc0 service nova] Creating event network-vif-plugged:212cff7d-b04b-4efb-be92-6dd1bd6ec779 for instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba on hv-cinder-80447 Feb 21 02:30:39.453057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-bd49d2ab-e3c8-438a-ba1c-bf8cf5459fe9 req-81df4edd-0bdb-451d-822e-c2eca9f0ebc0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068317 Feb 21 02:30:39.454568 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 259/501] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:39.595059 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-55630cbc-9a5e-4a34-aa7a-7e25882b5a9e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:39.603860 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-55630cbc-9a5e-4a34-aa7a-7e25882b5a9e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.216432 Feb 21 02:30:39.604437 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 243/502] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:39 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:39.852388 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0a281879-d816-490b-98b0-ee01ae2c5d62 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:39.853101 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0a281879-d816-490b-98b0-ee01ae2c5d62 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:39.859326 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0a281879-d816-490b-98b0-ee01ae2c5d62 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:39.860037 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0a281879-d816-490b-98b0-ee01ae2c5d62 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:39.860802 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0a281879-d816-490b-98b0-ee01ae2c5d62 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:39.861233 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0a281879-d816-490b-98b0-ee01ae2c5d62 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.005160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0a281879-d816-490b-98b0-ee01ae2c5d62 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:40.012346 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0a281879-d816-490b-98b0-ee01ae2c5d62 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.163993 Feb 21 02:30:40.012908 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 260/503] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:39 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:40.225317 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2c1e0e36-3364-4771-8bbd-f5d8ec6f75f6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:40.225942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2c1e0e36-3364-4771-8bbd-f5d8ec6f75f6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:40.232039 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2c1e0e36-3364-4771-8bbd-f5d8ec6f75f6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:40.232481 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2c1e0e36-3364-4771-8bbd-f5d8ec6f75f6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.233241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2c1e0e36-3364-4771-8bbd-f5d8ec6f75f6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:40.233687 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2c1e0e36-3364-4771-8bbd-f5d8ec6f75f6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.244626 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a0673a4c-bde5-41c5-a1a2-f49ddec88528 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:40.245237 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a0673a4c-bde5-41c5-a1a2-f49ddec88528 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:40.251006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a0673a4c-bde5-41c5-a1a2-f49ddec88528 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:40.251461 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a0673a4c-bde5-41c5-a1a2-f49ddec88528 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.254473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a0673a4c-bde5-41c5-a1a2-f49ddec88528 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:40.254993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a0673a4c-bde5-41c5-a1a2-f49ddec88528 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.259579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2c1e0e36-3364-4771-8bbd-f5d8ec6f75f6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:30:40.335392 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2c1e0e36-3364-4771-8bbd-f5d8ec6f75f6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "DELETE /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 204 len: 0 microversion: 2.1 time: 0.114122 Feb 21 02:30:40.336318 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 244/504] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:30:40 2022] DELETE /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:30:40.345270 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a9083291-cd78-4565-8963-91b4a2631d4b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:40.346148 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a9083291-cd78-4565-8963-91b4a2631d4b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:40.352811 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a9083291-cd78-4565-8963-91b4a2631d4b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:40.353258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a9083291-cd78-4565-8963-91b4a2631d4b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.354076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a9083291-cd78-4565-8963-91b4a2631d4b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:40.354509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a9083291-cd78-4565-8963-91b4a2631d4b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.403963 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a0673a4c-bde5-41c5-a1a2-f49ddec88528 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:40.413897 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a0673a4c-bde5-41c5-a1a2-f49ddec88528 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1567 microversion: 2.1 time: 0.172907 Feb 21 02:30:40.414467 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 261/505] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:40 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:40.501037 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a9083291-cd78-4565-8963-91b4a2631d4b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:40.508515 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a9083291-cd78-4565-8963-91b4a2631d4b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1513 microversion: 2.1 time: 0.167449 Feb 21 02:30:40.509174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 245/506] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:40 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:40.621359 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-83ca7628-0f79-4f59-a54a-5a38e7e36c6d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:40.621989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-83ca7628-0f79-4f59-a54a-5a38e7e36c6d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:40.627684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-83ca7628-0f79-4f59-a54a-5a38e7e36c6d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:40.628127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-83ca7628-0f79-4f59-a54a-5a38e7e36c6d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.628990 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-83ca7628-0f79-4f59-a54a-5a38e7e36c6d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:40.629427 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-83ca7628-0f79-4f59-a54a-5a38e7e36c6d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:40.762624 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-83ca7628-0f79-4f59-a54a-5a38e7e36c6d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:40.771192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-83ca7628-0f79-4f59-a54a-5a38e7e36c6d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.153476 Feb 21 02:30:40.771752 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 262/507] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:40 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:41.028174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-db45e747-b25d-4d7d-b51c-1c0aa2ab6844 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:41.028702 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-db45e747-b25d-4d7d-b51c-1c0aa2ab6844 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:41.035130 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db45e747-b25d-4d7d-b51c-1c0aa2ab6844 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.035575 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db45e747-b25d-4d7d-b51c-1c0aa2ab6844 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.036342 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db45e747-b25d-4d7d-b51c-1c0aa2ab6844 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.036771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db45e747-b25d-4d7d-b51c-1c0aa2ab6844 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.171591 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-db45e747-b25d-4d7d-b51c-1c0aa2ab6844 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:41.179507 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-db45e747-b25d-4d7d-b51c-1c0aa2ab6844 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.155107 Feb 21 02:30:41.180072 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 246/508] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:41 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:41.431182 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-effc4d9a-ebe3-45e8-8046-3f11adf6ad01 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:41.432066 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-effc4d9a-ebe3-45e8-8046-3f11adf6ad01 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:41.439604 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-effc4d9a-ebe3-45e8-8046-3f11adf6ad01 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.440044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-effc4d9a-ebe3-45e8-8046-3f11adf6ad01 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.441001 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-effc4d9a-ebe3-45e8-8046-3f11adf6ad01 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.441615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-effc4d9a-ebe3-45e8-8046-3f11adf6ad01 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.525339 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d4c681f1-af4e-4124-9ac7-97b935f4e057 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:41.525983 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d4c681f1-af4e-4124-9ac7-97b935f4e057 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:41.533563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d4c681f1-af4e-4124-9ac7-97b935f4e057 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.534705 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d4c681f1-af4e-4124-9ac7-97b935f4e057 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.535495 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d4c681f1-af4e-4124-9ac7-97b935f4e057 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.535924 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d4c681f1-af4e-4124-9ac7-97b935f4e057 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.578491 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-effc4d9a-ebe3-45e8-8046-3f11adf6ad01 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:41.586831 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-effc4d9a-ebe3-45e8-8046-3f11adf6ad01 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1547 microversion: 2.1 time: 0.159537 Feb 21 02:30:41.587398 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 263/509] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:41 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:41.603998 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:41.604481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:41.610531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.610972 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.611741 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.612284 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.675918 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d4c681f1-af4e-4124-9ac7-97b935f4e057 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:41.683565 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d4c681f1-af4e-4124-9ac7-97b935f4e057 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1513 microversion: 2.1 time: 0.161862 Feb 21 02:30:41.685701 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 247/510] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:41 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:41.695029 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] HTTP exception thrown: Cannot 'detach_volume' instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 while it is in vm_state rescued Feb 21 02:30:41.695719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Returning 409 to user: Cannot 'detach_volume' instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 while it is in vm_state rescued {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:30:41.696615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-680e6240-4480-4104-9b08-aec56c35b4a2 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments/16188598-1cb3-44d5-af55-45037a4b7c74" status: 409 len: 152 microversion: 2.1 time: 0.096292 Feb 21 02:30:41.697157 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 264/511] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:30:41 2022] DELETE /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments/16188598-1cb3-44d5-af55-45037a4b7c74 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 21 02:30:41.705271 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7882877f-bbc2-41df-b5e4-fd7c0a69d433 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:41.706142 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7882877f-bbc2-41df-b5e4-fd7c0a69d433 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:41.711941 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7882877f-bbc2-41df-b5e4-fd7c0a69d433 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.712390 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7882877f-bbc2-41df-b5e4-fd7c0a69d433 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.713162 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7882877f-bbc2-41df-b5e4-fd7c0a69d433 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.713595 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7882877f-bbc2-41df-b5e4-fd7c0a69d433 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.775920 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7882877f-bbc2-41df-b5e4-fd7c0a69d433 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/action" status: 202 len: 0 microversion: 2.1 time: 0.074052 Feb 21 02:30:41.776523 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 248/512] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:30:41 2022] POST /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 02:30:41.784989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ff06c09f-15c2-4aea-8172-11d791da4e52 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:41.785787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ff06c09f-15c2-4aea-8172-11d791da4e52 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:41.789722 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-15675580-5e16-49a4-8e75-b341463f7347 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:41.790420 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-15675580-5e16-49a4-8e75-b341463f7347 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:41.791948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ff06c09f-15c2-4aea-8172-11d791da4e52 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.792524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ff06c09f-15c2-4aea-8172-11d791da4e52 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.793331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ff06c09f-15c2-4aea-8172-11d791da4e52 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.793973 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ff06c09f-15c2-4aea-8172-11d791da4e52 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.798281 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15675580-5e16-49a4-8e75-b341463f7347 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.798754 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15675580-5e16-49a4-8e75-b341463f7347 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.800892 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15675580-5e16-49a4-8e75-b341463f7347 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:41.801428 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15675580-5e16-49a4-8e75-b341463f7347 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:41.936553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ff06c09f-15c2-4aea-8172-11d791da4e52 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:41.944991 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ff06c09f-15c2-4aea-8172-11d791da4e52 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.164227 Feb 21 02:30:41.945564 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 265/513] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:41 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:42.020382 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-15675580-5e16-49a4-8e75-b341463f7347 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:42.027507 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-15675580-5e16-49a4-8e75-b341463f7347 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.243478 Feb 21 02:30:42.028074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 249/514] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:41 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:42.195901 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-bf792dc0-bc13-415d-99bc-3ec418f533a6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:42.196509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-bf792dc0-bc13-415d-99bc-3ec418f533a6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:42.202279 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bf792dc0-bc13-415d-99bc-3ec418f533a6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:42.202724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bf792dc0-bc13-415d-99bc-3ec418f533a6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:42.203492 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bf792dc0-bc13-415d-99bc-3ec418f533a6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:42.203930 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bf792dc0-bc13-415d-99bc-3ec418f533a6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:42.352467 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bf792dc0-bc13-415d-99bc-3ec418f533a6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:42.360210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-bf792dc0-bc13-415d-99bc-3ec418f533a6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.167660 Feb 21 02:30:42.361044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 266/515] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:42 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:42.701758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-cc5504bb-c5a1-4a82-8ae8-600ab2166226 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:42.702519 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cc5504bb-c5a1-4a82-8ae8-600ab2166226 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:42.709860 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cc5504bb-c5a1-4a82-8ae8-600ab2166226 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:42.710313 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cc5504bb-c5a1-4a82-8ae8-600ab2166226 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:42.711077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cc5504bb-c5a1-4a82-8ae8-600ab2166226 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:42.711506 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cc5504bb-c5a1-4a82-8ae8-600ab2166226 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:42.863351 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-cc5504bb-c5a1-4a82-8ae8-600ab2166226 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:42.871159 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-cc5504bb-c5a1-4a82-8ae8-600ab2166226 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1513 microversion: 2.1 time: 0.173090 Feb 21 02:30:42.871858 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 250/516] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:42 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:42.962148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-088a3e17-1a34-4efb-8572-c518833b4d80 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:42.962753 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-088a3e17-1a34-4efb-8572-c518833b4d80 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:42.969172 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-088a3e17-1a34-4efb-8572-c518833b4d80 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:42.969626 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-088a3e17-1a34-4efb-8572-c518833b4d80 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:42.970460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-088a3e17-1a34-4efb-8572-c518833b4d80 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:42.970890 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-088a3e17-1a34-4efb-8572-c518833b4d80 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:43.045177 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3b1e258f-1488-4401-9469-de1beada30b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:43.047980 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3b1e258f-1488-4401-9469-de1beada30b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:43.052624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3b1e258f-1488-4401-9469-de1beada30b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:43.053077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3b1e258f-1488-4401-9469-de1beada30b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:43.055726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3b1e258f-1488-4401-9469-de1beada30b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:43.055726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3b1e258f-1488-4401-9469-de1beada30b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:43.132829 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-088a3e17-1a34-4efb-8572-c518833b4d80 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:43.142743 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-088a3e17-1a34-4efb-8572-c518833b4d80 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.184342 Feb 21 02:30:43.144756 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 267/517] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:42 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:43.229242 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3b1e258f-1488-4401-9469-de1beada30b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:43.239672 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3b1e258f-1488-4401-9469-de1beada30b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1260 microversion: 2.1 time: 0.198704 Feb 21 02:30:43.256574 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-28cb1689-a4aa-47ea-af6c-6ee0e1be18ac req-96136876-b39a-4d58-bc4c-44a2a874d8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e88ba1-3efc-43bb-a9fe-cea1161d320e", "name": "network-vif-plugged", "status": "completed", "tag": "a0143c80-ec51-407d-bae9-5a6f62cc1615"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:43.258615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:43.258615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:30:43.259485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 251/518] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:43 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:43.267851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-28cb1689-a4aa-47ea-af6c-6ee0e1be18ac req-96136876-b39a-4d58-bc4c-44a2a874d8d0 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:43.268503 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-28cb1689-a4aa-47ea-af6c-6ee0e1be18ac req-96136876-b39a-4d58-bc4c-44a2a874d8d0 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:43.285036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-28cb1689-a4aa-47ea-af6c-6ee0e1be18ac req-96136876-b39a-4d58-bc4c-44a2a874d8d0 service nova] Creating event network-vif-plugged:a0143c80-ec51-407d-bae9-5a6f62cc1615 for instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e on hv-cinder-80447 Feb 21 02:30:43.289958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-28cb1689-a4aa-47ea-af6c-6ee0e1be18ac req-96136876-b39a-4d58-bc4c-44a2a874d8d0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037691 Feb 21 02:30:43.290866 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 268/519] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:43.377549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d11e5bf9-b4e8-4b55-96b1-f927d0007f13 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:43.378705 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d11e5bf9-b4e8-4b55-96b1-f927d0007f13 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:43.384583 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d11e5bf9-b4e8-4b55-96b1-f927d0007f13 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:43.385031 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d11e5bf9-b4e8-4b55-96b1-f927d0007f13 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:43.385944 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d11e5bf9-b4e8-4b55-96b1-f927d0007f13 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:43.386383 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d11e5bf9-b4e8-4b55-96b1-f927d0007f13 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:43.537487 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d11e5bf9-b4e8-4b55-96b1-f927d0007f13 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:43.547628 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d11e5bf9-b4e8-4b55-96b1-f927d0007f13 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.173694 Feb 21 02:30:43.548410 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 252/520] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:43 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:43.891890 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8ae70c44-60f4-4d56-b1e0-d9a72a35d3d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:43.893179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8ae70c44-60f4-4d56-b1e0-d9a72a35d3d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:43.900038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ae70c44-60f4-4d56-b1e0-d9a72a35d3d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:43.900731 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ae70c44-60f4-4d56-b1e0-d9a72a35d3d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:43.903017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ae70c44-60f4-4d56-b1e0-d9a72a35d3d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:43.903017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ae70c44-60f4-4d56-b1e0-d9a72a35d3d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.118843 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8ae70c44-60f4-4d56-b1e0-d9a72a35d3d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:44.142449 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8ae70c44-60f4-4d56-b1e0-d9a72a35d3d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1513 microversion: 2.1 time: 0.251420 Feb 21 02:30:44.144224 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 269/521] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:43 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:44.161591 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-29dfa31b-1571-49da-ba1a-3fb82bfc11e7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:44.162274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-29dfa31b-1571-49da-ba1a-3fb82bfc11e7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:44.169188 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-29dfa31b-1571-49da-ba1a-3fb82bfc11e7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.169629 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-29dfa31b-1571-49da-ba1a-3fb82bfc11e7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.175943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-29dfa31b-1571-49da-ba1a-3fb82bfc11e7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.177077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-29dfa31b-1571-49da-ba1a-3fb82bfc11e7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.224857 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-a71bff8b-2137-4849-bb05-743dbaa4d628 req-b4c43c85-649c-434d-812b-60360ed24ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15be83cb-8289-45b8-950c-8677b8b55d6a", "name": "network-vif-deleted", "tag": "229a501b-9d18-485b-9959-7236956c786a"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:44.226903 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:44.226903 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:30:44.245373 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-a71bff8b-2137-4849-bb05-743dbaa4d628 req-b4c43c85-649c-434d-812b-60360ed24ed0 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.246343 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-a71bff8b-2137-4849-bb05-743dbaa4d628 req-b4c43c85-649c-434d-812b-60360ed24ed0 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.263363 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-a71bff8b-2137-4849-bb05-743dbaa4d628 req-b4c43c85-649c-434d-812b-60360ed24ed0 service nova] Creating event network-vif-deleted:229a501b-9d18-485b-9959-7236956c786a for instance 15be83cb-8289-45b8-950c-8677b8b55d6a on hv-cinder-80447 Feb 21 02:30:44.271123 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-a71bff8b-2137-4849-bb05-743dbaa4d628 req-b4c43c85-649c-434d-812b-60360ed24ed0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049518 Feb 21 02:30:44.272545 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 270/522] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:30:44.282217 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dba489e9-9b73-4dda-964c-0e5d55dd7409 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:44.283072 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dba489e9-9b73-4dda-964c-0e5d55dd7409 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:44.291475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dba489e9-9b73-4dda-964c-0e5d55dd7409 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.292389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dba489e9-9b73-4dda-964c-0e5d55dd7409 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.293438 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dba489e9-9b73-4dda-964c-0e5d55dd7409 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.294122 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dba489e9-9b73-4dda-964c-0e5d55dd7409 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.365131 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-29dfa31b-1571-49da-ba1a-3fb82bfc11e7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:44.376277 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-29dfa31b-1571-49da-ba1a-3fb82bfc11e7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.219177 Feb 21 02:30:44.377505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 253/523] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:44 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:44.473550 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-dba489e9-9b73-4dda-964c-0e5d55dd7409 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:44.482847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dba489e9-9b73-4dda-964c-0e5d55dd7409 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1444 microversion: 2.1 time: 0.208575 Feb 21 02:30:44.483440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 271/524] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:44 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1444 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:44.500453 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6221f94a-4d1a-40fb-9407-8434f456fc5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:44.501321 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6221f94a-4d1a-40fb-9407-8434f456fc5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:44.508026 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6221f94a-4d1a-40fb-9407-8434f456fc5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.508680 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6221f94a-4d1a-40fb-9407-8434f456fc5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.509458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6221f94a-4d1a-40fb-9407-8434f456fc5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.510090 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6221f94a-4d1a-40fb-9407-8434f456fc5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.568789 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-09e2ba18-d3e0-4661-84ae-00683bbb8fd3 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:44.570608 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-09e2ba18-d3e0-4661-84ae-00683bbb8fd3 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:44.578023 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09e2ba18-d3e0-4661-84ae-00683bbb8fd3 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.578628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09e2ba18-d3e0-4661-84ae-00683bbb8fd3 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.579606 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09e2ba18-d3e0-4661-84ae-00683bbb8fd3 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:44.580082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09e2ba18-d3e0-4661-84ae-00683bbb8fd3 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:44.667516 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6221f94a-4d1a-40fb-9407-8434f456fc5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:44.677895 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6221f94a-4d1a-40fb-9407-8434f456fc5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1444 microversion: 2.1 time: 0.180820 Feb 21 02:30:44.679040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 254/525] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:44 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1444 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:44.761998 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09e2ba18-d3e0-4661-84ae-00683bbb8fd3 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:44.771376 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-09e2ba18-d3e0-4661-84ae-00683bbb8fd3 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.210213 Feb 21 02:30:44.771949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 272/526] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:44 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:45.160498 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:45.161615 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:45.169250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:45.169816 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:45.170601 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:45.175156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:45.214637 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:45.215095 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:45.215543 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid 15be83cb-8289-45b8-950c-8677b8b55d6a {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:45.262494 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:45.271951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d0a0f457-2efc-4604-a4f2-2aeddc9225f9 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1307 microversion: 2.1 time: 0.116220 Feb 21 02:30:45.272552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 255/527] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:45 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:45.395790 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0dd900e1-4fe7-444a-ae99-d1aa991eaa07 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:45.396410 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0dd900e1-4fe7-444a-ae99-d1aa991eaa07 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:45.405398 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0dd900e1-4fe7-444a-ae99-d1aa991eaa07 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:45.405942 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0dd900e1-4fe7-444a-ae99-d1aa991eaa07 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:45.406847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0dd900e1-4fe7-444a-ae99-d1aa991eaa07 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:45.407350 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0dd900e1-4fe7-444a-ae99-d1aa991eaa07 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:45.716657 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0dd900e1-4fe7-444a-ae99-d1aa991eaa07 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:45.725780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0dd900e1-4fe7-444a-ae99-d1aa991eaa07 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.334937 Feb 21 02:30:45.726524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 273/528] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:45 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:45.791692 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2ed4b4d1-c6df-4fc2-abb0-b02bc2280ec8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:45.793103 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2ed4b4d1-c6df-4fc2-abb0-b02bc2280ec8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:45.799230 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2ed4b4d1-c6df-4fc2-abb0-b02bc2280ec8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:45.800227 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2ed4b4d1-c6df-4fc2-abb0-b02bc2280ec8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:45.802802 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2ed4b4d1-c6df-4fc2-abb0-b02bc2280ec8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:45.803261 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2ed4b4d1-c6df-4fc2-abb0-b02bc2280ec8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:45.951581 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2ed4b4d1-c6df-4fc2-abb0-b02bc2280ec8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:45.961535 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2ed4b4d1-c6df-4fc2-abb0-b02bc2280ec8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.176384 Feb 21 02:30:45.965782 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 256/529] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:45 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:46.290493 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:46.291230 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:46.297228 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:46.297805 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:46.298725 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:46.299194 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:46.334414 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:46.334866 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:46.335395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid 15be83cb-8289-45b8-950c-8677b8b55d6a {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:46.382875 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:46.390643 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c826a76d-dab4-403c-a8d9-f35a9d9bb596 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1307 microversion: 2.1 time: 0.105521 Feb 21 02:30:46.391227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 274/530] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:46 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:46.743933 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-27e37c90-3658-420a-b2a1-91f02bd88031 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:46.744549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-27e37c90-3658-420a-b2a1-91f02bd88031 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:46.754142 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27e37c90-3658-420a-b2a1-91f02bd88031 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:46.754850 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27e37c90-3658-420a-b2a1-91f02bd88031 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:46.756008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27e37c90-3658-420a-b2a1-91f02bd88031 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:46.757319 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-27e37c90-3658-420a-b2a1-91f02bd88031 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:46.915917 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-27e37c90-3658-420a-b2a1-91f02bd88031 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:46.927509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-27e37c90-3658-420a-b2a1-91f02bd88031 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.188209 Feb 21 02:30:46.928094 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 257/531] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:46 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:46.978237 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dcffafdf-6fee-417d-952a-21d71ed111f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:46.978845 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dcffafdf-6fee-417d-952a-21d71ed111f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:46.985336 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dcffafdf-6fee-417d-952a-21d71ed111f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:46.985861 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dcffafdf-6fee-417d-952a-21d71ed111f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:46.986687 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dcffafdf-6fee-417d-952a-21d71ed111f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:46.987722 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dcffafdf-6fee-417d-952a-21d71ed111f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:47.198515 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-1678c83e-f0e3-4fd1-a37b-e3b5afc1afc6 req-5afba17c-b71c-4af9-8372-75b030ac970e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28fd287f-356c-4485-ba82-bbe3da3cf5ba", "tag": "212cff7d-b04b-4efb-be92-6dd1bd6ec779"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:47.202774 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:47.202774 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:30:47.213450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-1678c83e-f0e3-4fd1-a37b-e3b5afc1afc6 req-5afba17c-b71c-4af9-8372-75b030ac970e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:47.215097 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-1678c83e-f0e3-4fd1-a37b-e3b5afc1afc6 req-5afba17c-b71c-4af9-8372-75b030ac970e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:47.215588 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-dcffafdf-6fee-417d-952a-21d71ed111f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:47.228727 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dcffafdf-6fee-417d-952a-21d71ed111f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.254181 Feb 21 02:30:47.229504 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 275/532] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:46 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:47.230474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-1678c83e-f0e3-4fd1-a37b-e3b5afc1afc6 req-5afba17c-b71c-4af9-8372-75b030ac970e service nova] Creating event network-changed:212cff7d-b04b-4efb-be92-6dd1bd6ec779 for instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba on hv-cinder-80447 Feb 21 02:30:47.235777 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-1678c83e-f0e3-4fd1-a37b-e3b5afc1afc6 req-5afba17c-b71c-4af9-8372-75b030ac970e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040792 Feb 21 02:30:47.236781 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 258/533] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:47.407024 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:47.408402 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:47.415399 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:47.416204 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:47.416799 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:47.417393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:47.453203 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:47.453668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:47.454285 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid 15be83cb-8289-45b8-950c-8677b8b55d6a {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:47.500880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:47.509308 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-068c1ba1-8e8d-4c70-a854-b337f4a220a8 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1307 microversion: 2.1 time: 0.105835 Feb 21 02:30:47.510325 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 276/534] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:47 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:47.948774 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-da4f526f-d94e-4c41-9935-dfa2f35c2886 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:47.949772 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-da4f526f-d94e-4c41-9935-dfa2f35c2886 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:47.956857 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-da4f526f-d94e-4c41-9935-dfa2f35c2886 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:47.957299 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-da4f526f-d94e-4c41-9935-dfa2f35c2886 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:47.958129 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-da4f526f-d94e-4c41-9935-dfa2f35c2886 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:47.958593 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-da4f526f-d94e-4c41-9935-dfa2f35c2886 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:48.109115 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-da4f526f-d94e-4c41-9935-dfa2f35c2886 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:48.121120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-da4f526f-d94e-4c41-9935-dfa2f35c2886 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.179850 Feb 21 02:30:48.121877 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 259/535] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:47 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:48.245906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3fc89da8-1b0b-438b-be64-da34f8d7290c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:48.246537 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3fc89da8-1b0b-438b-be64-da34f8d7290c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:48.253385 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3fc89da8-1b0b-438b-be64-da34f8d7290c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:48.253864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3fc89da8-1b0b-438b-be64-da34f8d7290c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:48.254648 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3fc89da8-1b0b-438b-be64-da34f8d7290c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:48.255075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3fc89da8-1b0b-438b-be64-da34f8d7290c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:48.404642 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3fc89da8-1b0b-438b-be64-da34f8d7290c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:48.413821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3fc89da8-1b0b-438b-be64-da34f8d7290c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.171439 Feb 21 02:30:48.414491 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 277/536] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:48 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:48.526036 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:48.526652 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:48.532745 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:48.533171 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:48.534885 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:48.535313 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:48.566642 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:48.567090 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:48.567536 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid 15be83cb-8289-45b8-950c-8677b8b55d6a {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:48.610080 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:48.618324 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ac5d79f8-0c7c-415d-bbaf-f16f7f1339d0 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1307 microversion: 2.1 time: 0.095984 Feb 21 02:30:48.618893 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 260/537] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:48 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:49.138837 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d4240628-ccb8-4959-a21a-e82a89fa59ca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:49.139452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d4240628-ccb8-4959-a21a-e82a89fa59ca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:49.146311 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d4240628-ccb8-4959-a21a-e82a89fa59ca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:49.147742 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d4240628-ccb8-4959-a21a-e82a89fa59ca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:49.148558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d4240628-ccb8-4959-a21a-e82a89fa59ca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:49.149510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d4240628-ccb8-4959-a21a-e82a89fa59ca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:49.285831 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d4240628-ccb8-4959-a21a-e82a89fa59ca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:49.293790 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d4240628-ccb8-4959-a21a-e82a89fa59ca tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.158644 Feb 21 02:30:49.294359 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 278/538] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:49 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:49.430367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-16ca6ad9-d623-478e-acee-33f5ef08e810 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:49.430973 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-16ca6ad9-d623-478e-acee-33f5ef08e810 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:49.437216 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-16ca6ad9-d623-478e-acee-33f5ef08e810 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:49.439091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-16ca6ad9-d623-478e-acee-33f5ef08e810 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:49.440664 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-16ca6ad9-d623-478e-acee-33f5ef08e810 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:49.441915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-16ca6ad9-d623-478e-acee-33f5ef08e810 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:49.587471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-16ca6ad9-d623-478e-acee-33f5ef08e810 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:49.594809 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-16ca6ad9-d623-478e-acee-33f5ef08e810 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.168064 Feb 21 02:30:49.595605 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 261/539] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:49 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:49.634495 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:49.635398 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:49.641521 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:49.641996 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:49.643679 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:49.644271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:49.675053 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:49.675481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:49.675920 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid 15be83cb-8289-45b8-950c-8677b8b55d6a {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:49.715304 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:49.723480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-979cff8c-7176-47d4-a05f-00b0f4b9dcf1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1307 microversion: 2.1 time: 0.092633 Feb 21 02:30:49.724044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 279/540] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:49 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:50.314189 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e958b274-6d1b-4e06-b989-2deffbcf23a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:50.315241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e958b274-6d1b-4e06-b989-2deffbcf23a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:50.324242 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e958b274-6d1b-4e06-b989-2deffbcf23a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:50.324939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e958b274-6d1b-4e06-b989-2deffbcf23a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:50.326246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e958b274-6d1b-4e06-b989-2deffbcf23a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:50.326925 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e958b274-6d1b-4e06-b989-2deffbcf23a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:50.466878 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e958b274-6d1b-4e06-b989-2deffbcf23a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:50.475685 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e958b274-6d1b-4e06-b989-2deffbcf23a0 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.167883 Feb 21 02:30:50.476406 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 262/541] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:50 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:50.612464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2a43d670-4a49-4794-8db0-b33ab25a19c5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:50.613212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2a43d670-4a49-4794-8db0-b33ab25a19c5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:50.619387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2a43d670-4a49-4794-8db0-b33ab25a19c5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:50.619833 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2a43d670-4a49-4794-8db0-b33ab25a19c5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:50.620584 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2a43d670-4a49-4794-8db0-b33ab25a19c5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:50.621014 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2a43d670-4a49-4794-8db0-b33ab25a19c5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:50.746110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:50.746725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:50.753544 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:50.754015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:50.754811 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:50.755248 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:50.760375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2a43d670-4a49-4794-8db0-b33ab25a19c5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:50.767517 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2a43d670-4a49-4794-8db0-b33ab25a19c5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.159172 Feb 21 02:30:50.768303 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 280/542] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:50 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:50.785283 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:50.785832 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:50.786277 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid 15be83cb-8289-45b8-950c-8677b8b55d6a {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:50.828756 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:50.836045 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-85659c74-a619-4116-8141-58546ed20417 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1307 microversion: 2.1 time: 0.093535 Feb 21 02:30:50.836604 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 263/543] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:50 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:51.492703 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-263eb2f4-2ba6-4287-9f8b-337e1af75ebe tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:51.493345 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-263eb2f4-2ba6-4287-9f8b-337e1af75ebe tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:51.499126 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-263eb2f4-2ba6-4287-9f8b-337e1af75ebe tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:51.499575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-263eb2f4-2ba6-4287-9f8b-337e1af75ebe tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:51.500351 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-263eb2f4-2ba6-4287-9f8b-337e1af75ebe tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:51.500789 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-263eb2f4-2ba6-4287-9f8b-337e1af75ebe tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:51.632293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-263eb2f4-2ba6-4287-9f8b-337e1af75ebe tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:51.639992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-263eb2f4-2ba6-4287-9f8b-337e1af75ebe tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.150900 Feb 21 02:30:51.640552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 281/544] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:51 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:51.784655 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d68c2cc3-38c6-4624-a2a9-119ef738b03f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:51.785292 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d68c2cc3-38c6-4624-a2a9-119ef738b03f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:51.791808 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d68c2cc3-38c6-4624-a2a9-119ef738b03f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:51.792259 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d68c2cc3-38c6-4624-a2a9-119ef738b03f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:51.793038 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d68c2cc3-38c6-4624-a2a9-119ef738b03f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:51.793471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d68c2cc3-38c6-4624-a2a9-119ef738b03f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:51.852024 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:51.852635 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:51.858419 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:51.858873 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:51.859905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:51.860349 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:51.892147 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:51.892517 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:51.893048 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid 15be83cb-8289-45b8-950c-8677b8b55d6a {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:51.929073 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d68c2cc3-38c6-4624-a2a9-119ef738b03f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:51.932740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:51.936420 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d68c2cc3-38c6-4624-a2a9-119ef738b03f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.155735 Feb 21 02:30:51.936999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 264/545] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:51 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:51.940495 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-04de6182-0fdf-440f-a341-073c1aad3fa4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 200 len: 1307 microversion: 2.1 time: 0.091456 Feb 21 02:30:51.941209 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 282/546] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:51 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:30:52.657467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-247f43a4-0530-4c7c-bb1c-40f5e7ef1d35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:52.658121 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-247f43a4-0530-4c7c-bb1c-40f5e7ef1d35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:52.664262 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-247f43a4-0530-4c7c-bb1c-40f5e7ef1d35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:52.664706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-247f43a4-0530-4c7c-bb1c-40f5e7ef1d35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:52.665476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-247f43a4-0530-4c7c-bb1c-40f5e7ef1d35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:52.666052 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-247f43a4-0530-4c7c-bb1c-40f5e7ef1d35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:52.872376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-247f43a4-0530-4c7c-bb1c-40f5e7ef1d35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:52.880977 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-247f43a4-0530-4c7c-bb1c-40f5e7ef1d35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.227152 Feb 21 02:30:52.881544 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 265/547] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:52 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:52.953996 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dd5e7072-b747-4592-ac24-fb9e7c9dc3f9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:52.954615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dd5e7072-b747-4592-ac24-fb9e7c9dc3f9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:52.955774 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:52.956372 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 15be83cb-8289-45b8-950c-8677b8b55d6a] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:52.960998 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dd5e7072-b747-4592-ac24-fb9e7c9dc3f9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:52.961419 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dd5e7072-b747-4592-ac24-fb9e7c9dc3f9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:52.962001 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:52.962233 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dd5e7072-b747-4592-ac24-fb9e7c9dc3f9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:52.962437 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:52.962668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dd5e7072-b747-4592-ac24-fb9e7c9dc3f9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:52.963200 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:52.963626 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:52.977899 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] HTTP exception thrown: Instance 15be83cb-8289-45b8-950c-8677b8b55d6a could not be found. Feb 21 02:30:52.978641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Returning 404 to user: Instance 15be83cb-8289-45b8-950c-8677b8b55d6a could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:30:52.979471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0be27bb6-1882-4d28-9310-c6dbe292dd49 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a" status: 404 len: 111 microversion: 2.1 time: 0.027305 Feb 21 02:30:52.980015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 266/548] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:52 2022] GET /compute/v2.1/servers/15be83cb-8289-45b8-950c-8677b8b55d6a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 02:30:53.108008 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-dd5e7072-b747-4592-ac24-fb9e7c9dc3f9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:53.116242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dd5e7072-b747-4592-ac24-fb9e7c9dc3f9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.165931 Feb 21 02:30:53.116812 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 283/549] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:52 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:53.897552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c9ee51b2-cccd-4f0c-8a99-1ead543200bd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:53.898180 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c9ee51b2-cccd-4f0c-8a99-1ead543200bd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:53.904332 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c9ee51b2-cccd-4f0c-8a99-1ead543200bd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:53.904755 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c9ee51b2-cccd-4f0c-8a99-1ead543200bd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:53.905526 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c9ee51b2-cccd-4f0c-8a99-1ead543200bd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:53.905997 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c9ee51b2-cccd-4f0c-8a99-1ead543200bd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:54.045161 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c9ee51b2-cccd-4f0c-8a99-1ead543200bd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:54.053476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c9ee51b2-cccd-4f0c-8a99-1ead543200bd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.159615 Feb 21 02:30:54.054174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 267/550] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:53 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:54.132702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9d8c2bec-bfa9-44d0-9077-71fe7d0bb729 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:54.133303 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9d8c2bec-bfa9-44d0-9077-71fe7d0bb729 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:54.139614 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9d8c2bec-bfa9-44d0-9077-71fe7d0bb729 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:54.140301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9d8c2bec-bfa9-44d0-9077-71fe7d0bb729 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:54.141071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9d8c2bec-bfa9-44d0-9077-71fe7d0bb729 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:54.141506 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9d8c2bec-bfa9-44d0-9077-71fe7d0bb729 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:54.278427 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9d8c2bec-bfa9-44d0-9077-71fe7d0bb729 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:54.286227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9d8c2bec-bfa9-44d0-9077-71fe7d0bb729 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1265 microversion: 2.1 time: 0.157787 Feb 21 02:30:54.286796 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 284/551] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:54 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:55.071866 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-185a8fa7-b4a7-461f-92f5-d8b50b565210 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:55.072397 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-185a8fa7-b4a7-461f-92f5-d8b50b565210 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:55.080272 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-185a8fa7-b4a7-461f-92f5-d8b50b565210 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:55.080934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-185a8fa7-b4a7-461f-92f5-d8b50b565210 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:55.082016 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-185a8fa7-b4a7-461f-92f5-d8b50b565210 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:55.082485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-185a8fa7-b4a7-461f-92f5-d8b50b565210 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:55.216038 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-185a8fa7-b4a7-461f-92f5-d8b50b565210 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:55.224513 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-185a8fa7-b4a7-461f-92f5-d8b50b565210 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1555 microversion: 2.1 time: 0.157160 Feb 21 02:30:55.225072 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 268/552] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:55 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:55.303040 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a68da286-a36a-4f2a-8005-03d8808cbbd6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:55.303641 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a68da286-a36a-4f2a-8005-03d8808cbbd6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:55.309831 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a68da286-a36a-4f2a-8005-03d8808cbbd6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:55.310282 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a68da286-a36a-4f2a-8005-03d8808cbbd6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:55.311047 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a68da286-a36a-4f2a-8005-03d8808cbbd6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:55.311480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a68da286-a36a-4f2a-8005-03d8808cbbd6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:55.453775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a68da286-a36a-4f2a-8005-03d8808cbbd6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:55.461526 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a68da286-a36a-4f2a-8005-03d8808cbbd6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1451 microversion: 2.1 time: 0.162767 Feb 21 02:30:55.462108 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 285/553] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:55 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:55.477540 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2d43b81c-6ed5-42e9-9d33-934d897ed865 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:55.478202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2d43b81c-6ed5-42e9-9d33-934d897ed865 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:55.483958 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2d43b81c-6ed5-42e9-9d33-934d897ed865 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:55.484398 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2d43b81c-6ed5-42e9-9d33-934d897ed865 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:55.485437 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2d43b81c-6ed5-42e9-9d33-934d897ed865 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:55.485892 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2d43b81c-6ed5-42e9-9d33-934d897ed865 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:55.622526 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2d43b81c-6ed5-42e9-9d33-934d897ed865 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:55.630703 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2d43b81c-6ed5-42e9-9d33-934d897ed865 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1451 microversion: 2.1 time: 0.156806 Feb 21 02:30:55.631396 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 269/554] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:55 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:56.241827 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e69f40d9-482b-465e-8e3a-5588ff521120 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:56.242430 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e69f40d9-482b-465e-8e3a-5588ff521120 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:56.248800 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e69f40d9-482b-465e-8e3a-5588ff521120 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:56.249245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e69f40d9-482b-465e-8e3a-5588ff521120 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:56.250053 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e69f40d9-482b-465e-8e3a-5588ff521120 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:56.250483 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e69f40d9-482b-465e-8e3a-5588ff521120 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:56.499530 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e69f40d9-482b-465e-8e3a-5588ff521120 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:56.507812 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e69f40d9-482b-465e-8e3a-5588ff521120 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1561 microversion: 2.1 time: 0.269542 Feb 21 02:30:56.508419 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 286/555] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:56 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1561 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:56.574217 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-99dce079-170c-4d7d-9e58-6026f9926418 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:56.574714 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-99dce079-170c-4d7d-9e58-6026f9926418 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:56.581464 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-99dce079-170c-4d7d-9e58-6026f9926418 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:56.581946 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-99dce079-170c-4d7d-9e58-6026f9926418 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:56.582725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-99dce079-170c-4d7d-9e58-6026f9926418 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:56.583163 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-99dce079-170c-4d7d-9e58-6026f9926418 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:56.663875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-99dce079-170c-4d7d-9e58-6026f9926418 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lazy-loading 'services' on Instance uuid 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:30:56.737893 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-99dce079-170c-4d7d-9e58-6026f9926418 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments/16188598-1cb3-44d5-af55-45037a4b7c74" status: 202 len: 0 microversion: 2.1 time: 0.166418 Feb 21 02:30:56.738783 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 270/556] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:30:56 2022] DELETE /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments/16188598-1cb3-44d5-af55-45037a4b7c74 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 02:30:56.747522 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2cab093b-d2ea-4f21-9de7-bc617f3e614f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:56.748816 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2cab093b-d2ea-4f21-9de7-bc617f3e614f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:56.755866 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2cab093b-d2ea-4f21-9de7-bc617f3e614f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:56.756810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2cab093b-d2ea-4f21-9de7-bc617f3e614f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:56.757972 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2cab093b-d2ea-4f21-9de7-bc617f3e614f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:56.758549 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2cab093b-d2ea-4f21-9de7-bc617f3e614f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:56.794877 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2cab093b-d2ea-4f21-9de7-bc617f3e614f tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051477 Feb 21 02:30:56.795468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 287/557] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:56 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:57.662722 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-f33c80bd-4a55-443c-b39b-faca6b0e530f req-32d27453-8ff0-40b8-84b2-844f0e16ff0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e88ba1-3efc-43bb-a9fe-cea1161d320e", "tag": "a0143c80-ec51-407d-bae9-5a6f62cc1615"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:30:57.664250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:30:57.664250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:30:57.671380 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-f33c80bd-4a55-443c-b39b-faca6b0e530f req-32d27453-8ff0-40b8-84b2-844f0e16ff0e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:57.671828 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-f33c80bd-4a55-443c-b39b-faca6b0e530f req-32d27453-8ff0-40b8-84b2-844f0e16ff0e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:57.682699 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-f33c80bd-4a55-443c-b39b-faca6b0e530f req-32d27453-8ff0-40b8-84b2-844f0e16ff0e service nova] Creating event network-changed:a0143c80-ec51-407d-bae9-5a6f62cc1615 for instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e on hv-cinder-80447 Feb 21 02:30:57.687990 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-f33c80bd-4a55-443c-b39b-faca6b0e530f req-32d27453-8ff0-40b8-84b2-844f0e16ff0e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029755 Feb 21 02:30:57.688587 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 271/558] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:57.809429 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-bad3d4b2-017b-4a34-af53-6f51a9725bec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:57.810550 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-bad3d4b2-017b-4a34-af53-6f51a9725bec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:57.817873 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bad3d4b2-017b-4a34-af53-6f51a9725bec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:57.818467 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bad3d4b2-017b-4a34-af53-6f51a9725bec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:57.819266 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bad3d4b2-017b-4a34-af53-6f51a9725bec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:57.819705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bad3d4b2-017b-4a34-af53-6f51a9725bec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:57.851417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-bad3d4b2-017b-4a34-af53-6f51a9725bec tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048028 Feb 21 02:30:57.855296 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 288/559] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:57 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:58.867226 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bc5d31f2-6b75-4eda-acf3-9064e7f0b500 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:58.868600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bc5d31f2-6b75-4eda-acf3-9064e7f0b500 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:58.874999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bc5d31f2-6b75-4eda-acf3-9064e7f0b500 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:58.875441 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bc5d31f2-6b75-4eda-acf3-9064e7f0b500 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:58.876208 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bc5d31f2-6b75-4eda-acf3-9064e7f0b500 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:58.876640 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bc5d31f2-6b75-4eda-acf3-9064e7f0b500 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:58.905065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bc5d31f2-6b75-4eda-acf3-9064e7f0b500 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045853 Feb 21 02:30:58.905613 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 272/560] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:58 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:30:59.355146 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2ca414c4-7db9-4795-9f86-69834d942b9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:59.355649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2ca414c4-7db9-4795-9f86-69834d942b9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:59.362738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2ca414c4-7db9-4795-9f86-69834d942b9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:59.363176 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2ca414c4-7db9-4795-9f86-69834d942b9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:59.363947 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2ca414c4-7db9-4795-9f86-69834d942b9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:59.364376 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2ca414c4-7db9-4795-9f86-69834d942b9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:59.389407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2ca414c4-7db9-4795-9f86-69834d942b9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:30:59.461305 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2ca414c4-7db9-4795-9f86-69834d942b9a tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "DELETE /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 204 len: 0 microversion: 2.1 time: 0.109481 Feb 21 02:30:59.461925 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 289/561] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:30:59 2022] DELETE /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:30:59.469510 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-685b6fb2-06ea-4054-ad8f-4a91f75a02db tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:59.470223 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-685b6fb2-06ea-4054-ad8f-4a91f75a02db tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:59.477060 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-685b6fb2-06ea-4054-ad8f-4a91f75a02db tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:59.477501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-685b6fb2-06ea-4054-ad8f-4a91f75a02db tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:59.478373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-685b6fb2-06ea-4054-ad8f-4a91f75a02db tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:59.478896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-685b6fb2-06ea-4054-ad8f-4a91f75a02db tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:59.621425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-685b6fb2-06ea-4054-ad8f-4a91f75a02db tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:30:59.629253 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-685b6fb2-06ea-4054-ad8f-4a91f75a02db tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1513 microversion: 2.1 time: 0.163395 Feb 21 02:30:59.629826 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 273/562] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:30:59 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:30:59.916700 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a69ba635-f582-4c7d-9717-975334061848 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:30:59.917754 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a69ba635-f582-4c7d-9717-975334061848 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:30:59.923562 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a69ba635-f582-4c7d-9717-975334061848 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:59.924810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a69ba635-f582-4c7d-9717-975334061848 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:59.925734 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a69ba635-f582-4c7d-9717-975334061848 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:30:59.926178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a69ba635-f582-4c7d-9717-975334061848 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:30:59.954828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a69ba635-f582-4c7d-9717-975334061848 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042159 Feb 21 02:30:59.955380 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 290/563] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:30:59 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:31:00.646036 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d32d6739-bed9-4f32-9b09-8eda49ab2bef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:00.646642 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d32d6739-bed9-4f32-9b09-8eda49ab2bef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:00.652726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d32d6739-bed9-4f32-9b09-8eda49ab2bef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:00.653162 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d32d6739-bed9-4f32-9b09-8eda49ab2bef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:00.653959 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d32d6739-bed9-4f32-9b09-8eda49ab2bef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:00.654389 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d32d6739-bed9-4f32-9b09-8eda49ab2bef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:00.784664 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d32d6739-bed9-4f32-9b09-8eda49ab2bef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:00.791920 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d32d6739-bed9-4f32-9b09-8eda49ab2bef tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1513 microversion: 2.1 time: 0.149606 Feb 21 02:31:00.792484 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 274/564] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:00 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:00.966165 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ef70db42-bac4-43b8-8a43-39a2e823cfaa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:00.967230 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ef70db42-bac4-43b8-8a43-39a2e823cfaa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:00.974770 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ef70db42-bac4-43b8-8a43-39a2e823cfaa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:00.975347 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ef70db42-bac4-43b8-8a43-39a2e823cfaa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:00.976158 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ef70db42-bac4-43b8-8a43-39a2e823cfaa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:00.976587 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ef70db42-bac4-43b8-8a43-39a2e823cfaa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:01.008118 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ef70db42-bac4-43b8-8a43-39a2e823cfaa tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046033 Feb 21 02:31:01.008662 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 291/565] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:31:00 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:31:01.808907 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-dd53e87d-882a-4b95-bfdd-f0d4384f0a7f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:01.809565 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-dd53e87d-882a-4b95-bfdd-f0d4384f0a7f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:01.816716 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dd53e87d-882a-4b95-bfdd-f0d4384f0a7f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:01.817169 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dd53e87d-882a-4b95-bfdd-f0d4384f0a7f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:01.818013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dd53e87d-882a-4b95-bfdd-f0d4384f0a7f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:01.818447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dd53e87d-882a-4b95-bfdd-f0d4384f0a7f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:01.952231 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-dd53e87d-882a-4b95-bfdd-f0d4384f0a7f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:01.960361 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-dd53e87d-882a-4b95-bfdd-f0d4384f0a7f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1513 microversion: 2.1 time: 0.155385 Feb 21 02:31:01.960931 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 275/566] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:01 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:02.019712 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-584fd590-8b15-41ba-844c-b3d5e30feadb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:02.020612 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-584fd590-8b15-41ba-844c-b3d5e30feadb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:02.026900 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-584fd590-8b15-41ba-844c-b3d5e30feadb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:02.027353 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-584fd590-8b15-41ba-844c-b3d5e30feadb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:02.028109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-584fd590-8b15-41ba-844c-b3d5e30feadb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:02.028537 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-584fd590-8b15-41ba-844c-b3d5e30feadb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:02.057948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-584fd590-8b15-41ba-844c-b3d5e30feadb tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041879 Feb 21 02:31:02.058512 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 292/567] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:31:02 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 02:31:02.491542 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-44225cf7-f394-4540-9e4b-ef9d03ee19f1 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06ff58ba-9038-441b-9363-c29229aa2437", "device": "/dev/sdb"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:02.493211 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-44225cf7-f394-4540-9e4b-ef9d03ee19f1 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:02.499064 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-44225cf7-f394-4540-9e4b-ef9d03ee19f1 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:02.499501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-44225cf7-f394-4540-9e4b-ef9d03ee19f1 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:02.500275 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-44225cf7-f394-4540-9e4b-ef9d03ee19f1 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:02.500699 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-44225cf7-f394-4540-9e4b-ef9d03ee19f1 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:02.581551 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-d9a9d803-dad8-40d1-b64e-5e006fadedda req-6e01fa04-3e37-4b7a-a402-2932ebeea679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291df513-4591-43c9-89d7-f9974ba6f5c2", "name": "network-vif-deleted", "tag": "859d3f05-bcb1-4fc1-b70f-b6eb03a8cb84"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:02.583846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:31:02.583846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:31:02.592434 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-d9a9d803-dad8-40d1-b64e-5e006fadedda req-6e01fa04-3e37-4b7a-a402-2932ebeea679 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:02.593241 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-d9a9d803-dad8-40d1-b64e-5e006fadedda req-6e01fa04-3e37-4b7a-a402-2932ebeea679 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:02.606978 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-d9a9d803-dad8-40d1-b64e-5e006fadedda req-6e01fa04-3e37-4b7a-a402-2932ebeea679 service nova] Creating event network-vif-deleted:859d3f05-bcb1-4fc1-b70f-b6eb03a8cb84 for instance 291df513-4591-43c9-89d7-f9974ba6f5c2 on hv-cinder-80447 Feb 21 02:31:02.615454 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-d9a9d803-dad8-40d1-b64e-5e006fadedda req-6e01fa04-3e37-4b7a-a402-2932ebeea679 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038914 Feb 21 02:31:02.616057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 293/568] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:31:02.810703 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-44225cf7-f394-4540-9e4b-ef9d03ee19f1 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "POST /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324156 Feb 21 02:31:02.813677 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 276/569] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:31:02 2022] POST /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:31:02.976999 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:02.977793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:02.984204 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:02.984911 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:02.985712 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:02.986155 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:03.015877 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:03.016322 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:03.016767 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid 291df513-4591-43c9-89d7-f9974ba6f5c2 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:31:03.058041 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:03.065280 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c128cfe8-a5e1-4e22-a7ca-3bb71c59c706 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 200 len: 1308 microversion: 2.1 time: 0.092256 Feb 21 02:31:03.065870 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 294/570] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:02 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:04.083036 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:04.083648 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: 291df513-4591-43c9-89d7-f9974ba6f5c2] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:04.089692 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.090137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.091047 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.091477 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.104485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] HTTP exception thrown: Instance 291df513-4591-43c9-89d7-f9974ba6f5c2 could not be found. Feb 21 02:31:04.105047 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Returning 404 to user: Instance 291df513-4591-43c9-89d7-f9974ba6f5c2 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:31:04.105867 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e7c47235-3a72-43a4-af25-d4ae0a8c9296 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2" status: 404 len: 111 microversion: 2.1 time: 0.027566 Feb 21 02:31:04.106373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 277/571] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:04 2022] GET /compute/v2.1/servers/291df513-4591-43c9-89d7-f9974ba6f5c2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:31:04.115150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-90d18b39-4d73-4dac-8df3-6fdb69a0e0a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:04.115650 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-90d18b39-4d73-4dac-8df3-6fdb69a0e0a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:04.121865 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90d18b39-4d73-4dac-8df3-6fdb69a0e0a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.122300 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90d18b39-4d73-4dac-8df3-6fdb69a0e0a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.123067 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90d18b39-4d73-4dac-8df3-6fdb69a0e0a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.123495 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90d18b39-4d73-4dac-8df3-6fdb69a0e0a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.147328 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-90d18b39-4d73-4dac-8df3-6fdb69a0e0a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:31:04.218291 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-90d18b39-4d73-4dac-8df3-6fdb69a0e0a7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 204 len: 0 microversion: 2.1 time: 0.107281 Feb 21 02:31:04.219153 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 295/572] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:31:04 2022] DELETE /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:31:04.227565 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1fd40383-2aca-4540-aeaa-ee0c5c13a243 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:04.228172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1fd40383-2aca-4540-aeaa-ee0c5c13a243 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:04.234410 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1fd40383-2aca-4540-aeaa-ee0c5c13a243 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.235113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1fd40383-2aca-4540-aeaa-ee0c5c13a243 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.235876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1fd40383-2aca-4540-aeaa-ee0c5c13a243 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.236505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1fd40383-2aca-4540-aeaa-ee0c5c13a243 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.369404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-62000f25-4944-4464-b0cc-02afa7ba877b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:04.370026 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-62000f25-4944-4464-b0cc-02afa7ba877b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:04.372120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1fd40383-2aca-4540-aeaa-ee0c5c13a243 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:04.375892 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-62000f25-4944-4464-b0cc-02afa7ba877b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.376340 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-62000f25-4944-4464-b0cc-02afa7ba877b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.377533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-62000f25-4944-4464-b0cc-02afa7ba877b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.378104 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-62000f25-4944-4464-b0cc-02afa7ba877b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.379364 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1fd40383-2aca-4540-aeaa-ee0c5c13a243 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1513 microversion: 2.1 time: 0.155580 Feb 21 02:31:04.379918 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 278/573] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:04 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:04.402829 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-62000f25-4944-4464-b0cc-02afa7ba877b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:31:04.472914 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-62000f25-4944-4464-b0cc-02afa7ba877b tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 204 len: 0 microversion: 2.1 time: 0.107893 Feb 21 02:31:04.473502 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 296/574] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:31:04 2022] DELETE /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 02:31:04.481182 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-37a44774-75ff-4ff3-a81f-60ed4e52a5e1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:04.481879 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-37a44774-75ff-4ff3-a81f-60ed4e52a5e1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:04.488754 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37a44774-75ff-4ff3-a81f-60ed4e52a5e1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.489202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37a44774-75ff-4ff3-a81f-60ed4e52a5e1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.490015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37a44774-75ff-4ff3-a81f-60ed4e52a5e1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:04.490450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-37a44774-75ff-4ff3-a81f-60ed4e52a5e1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:04.622624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-37a44774-75ff-4ff3-a81f-60ed4e52a5e1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:04.630579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-37a44774-75ff-4ff3-a81f-60ed4e52a5e1 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1507 microversion: 2.1 time: 0.153076 Feb 21 02:31:04.631140 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 279/575] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:04 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:05.396625 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0ee98c70-4cfd-4ae0-96f5-5bc80d3004d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:05.397324 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0ee98c70-4cfd-4ae0-96f5-5bc80d3004d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:05.403560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0ee98c70-4cfd-4ae0-96f5-5bc80d3004d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:05.404015 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0ee98c70-4cfd-4ae0-96f5-5bc80d3004d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:05.404789 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0ee98c70-4cfd-4ae0-96f5-5bc80d3004d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:05.405225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0ee98c70-4cfd-4ae0-96f5-5bc80d3004d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:05.537560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0ee98c70-4cfd-4ae0-96f5-5bc80d3004d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:05.544792 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0ee98c70-4cfd-4ae0-96f5-5bc80d3004d1 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1513 microversion: 2.1 time: 0.152269 Feb 21 02:31:05.545357 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 297/576] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:05 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:05.647413 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7e4a2903-543b-41d2-89ee-9f975d24a3d7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:05.648019 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7e4a2903-543b-41d2-89ee-9f975d24a3d7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:05.654197 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7e4a2903-543b-41d2-89ee-9f975d24a3d7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:05.654643 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7e4a2903-543b-41d2-89ee-9f975d24a3d7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:05.655413 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7e4a2903-543b-41d2-89ee-9f975d24a3d7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:05.655842 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7e4a2903-543b-41d2-89ee-9f975d24a3d7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:05.789168 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7e4a2903-543b-41d2-89ee-9f975d24a3d7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:05.796354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7e4a2903-543b-41d2-89ee-9f975d24a3d7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1507 microversion: 2.1 time: 0.152647 Feb 21 02:31:05.796920 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 280/577] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:05 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:06.561958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c4c55aeb-559e-4be5-8430-989b51516aa6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:06.562557 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c4c55aeb-559e-4be5-8430-989b51516aa6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:06.569423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c4c55aeb-559e-4be5-8430-989b51516aa6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:06.569904 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c4c55aeb-559e-4be5-8430-989b51516aa6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:06.570668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c4c55aeb-559e-4be5-8430-989b51516aa6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:06.571095 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c4c55aeb-559e-4be5-8430-989b51516aa6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:06.703703 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c4c55aeb-559e-4be5-8430-989b51516aa6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:06.711061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c4c55aeb-559e-4be5-8430-989b51516aa6 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1513 microversion: 2.1 time: 0.152683 Feb 21 02:31:06.711629 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 298/578] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:06 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:06.813753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d9d31f49-4677-48ec-b6dd-b0194e92ca35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:06.815197 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d9d31f49-4677-48ec-b6dd-b0194e92ca35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:06.821023 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d9d31f49-4677-48ec-b6dd-b0194e92ca35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:06.821463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d9d31f49-4677-48ec-b6dd-b0194e92ca35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:06.822328 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d9d31f49-4677-48ec-b6dd-b0194e92ca35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:06.822757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d9d31f49-4677-48ec-b6dd-b0194e92ca35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:06.954269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d9d31f49-4677-48ec-b6dd-b0194e92ca35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:06.961408 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d9d31f49-4677-48ec-b6dd-b0194e92ca35 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1507 microversion: 2.1 time: 0.151341 Feb 21 02:31:06.961995 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 281/579] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:06 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:07.727541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c559c036-bbbd-4a5d-8d48-834f213fe0e7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:07.728142 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c559c036-bbbd-4a5d-8d48-834f213fe0e7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:07.734415 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c559c036-bbbd-4a5d-8d48-834f213fe0e7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:07.735113 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c559c036-bbbd-4a5d-8d48-834f213fe0e7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:07.735878 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c559c036-bbbd-4a5d-8d48-834f213fe0e7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:07.736864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c559c036-bbbd-4a5d-8d48-834f213fe0e7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:07.869498 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c559c036-bbbd-4a5d-8d48-834f213fe0e7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:07.877354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c559c036-bbbd-4a5d-8d48-834f213fe0e7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1513 microversion: 2.1 time: 0.153434 Feb 21 02:31:07.877939 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 299/580] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:07 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:07.977714 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8c20fddb-9810-4a0e-b8f3-994dd12298da tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:07.978275 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8c20fddb-9810-4a0e-b8f3-994dd12298da tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:07.984484 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8c20fddb-9810-4a0e-b8f3-994dd12298da tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:07.985183 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8c20fddb-9810-4a0e-b8f3-994dd12298da tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:07.986084 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8c20fddb-9810-4a0e-b8f3-994dd12298da tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:07.986584 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8c20fddb-9810-4a0e-b8f3-994dd12298da tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:08.119120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8c20fddb-9810-4a0e-b8f3-994dd12298da tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:08.126368 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8c20fddb-9810-4a0e-b8f3-994dd12298da tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1507 microversion: 2.1 time: 0.152363 Feb 21 02:31:08.127007 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 282/581] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:07 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:08.894183 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4b1c39ec-790b-44c1-82dd-58acfe9fc5c7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:08.894861 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4b1c39ec-790b-44c1-82dd-58acfe9fc5c7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:08.901225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4b1c39ec-790b-44c1-82dd-58acfe9fc5c7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:08.901697 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4b1c39ec-790b-44c1-82dd-58acfe9fc5c7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:08.902480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4b1c39ec-790b-44c1-82dd-58acfe9fc5c7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:08.902939 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4b1c39ec-790b-44c1-82dd-58acfe9fc5c7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:09.036977 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4b1c39ec-790b-44c1-82dd-58acfe9fc5c7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:09.044118 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4b1c39ec-790b-44c1-82dd-58acfe9fc5c7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1513 microversion: 2.1 time: 0.153920 Feb 21 02:31:09.044682 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 300/582] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:08 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:09.142899 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-103596d9-e8f4-4877-a5ae-5772c751ac24 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:09.143508 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-103596d9-e8f4-4877-a5ae-5772c751ac24 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:09.149585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-103596d9-e8f4-4877-a5ae-5772c751ac24 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:09.150071 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-103596d9-e8f4-4877-a5ae-5772c751ac24 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:09.150844 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-103596d9-e8f4-4877-a5ae-5772c751ac24 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:09.151281 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-103596d9-e8f4-4877-a5ae-5772c751ac24 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:09.289234 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-103596d9-e8f4-4877-a5ae-5772c751ac24 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:09.296419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-103596d9-e8f4-4877-a5ae-5772c751ac24 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1507 microversion: 2.1 time: 0.157186 Feb 21 02:31:09.296986 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 283/583] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:09 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:10.060809 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-89df7296-2c30-470b-90bf-cf284ea543f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:10.061534 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-89df7296-2c30-470b-90bf-cf284ea543f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:10.068773 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89df7296-2c30-470b-90bf-cf284ea543f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:10.069223 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89df7296-2c30-470b-90bf-cf284ea543f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:10.070043 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89df7296-2c30-470b-90bf-cf284ea543f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:10.070480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-89df7296-2c30-470b-90bf-cf284ea543f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:10.217026 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-89df7296-2c30-470b-90bf-cf284ea543f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:10.225541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-89df7296-2c30-470b-90bf-cf284ea543f2 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1513 microversion: 2.1 time: 0.168371 Feb 21 02:31:10.226227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 301/584] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:10 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:10.313823 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ea291a10-6345-4453-a536-4e485e642c09 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:10.315634 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ea291a10-6345-4453-a536-4e485e642c09 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:10.321849 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ea291a10-6345-4453-a536-4e485e642c09 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:10.322295 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ea291a10-6345-4453-a536-4e485e642c09 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:10.323093 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ea291a10-6345-4453-a536-4e485e642c09 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:10.323525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ea291a10-6345-4453-a536-4e485e642c09 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:10.778151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-8c34ca81-4143-4832-b551-7ae43a862266 req-b9e3772b-9b90-42ac-8ccf-020b09f0f722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb", "name": "network-vif-deleted", "tag": "b84a1600-9302-43ac-8004-61bd10577802"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:10.780449 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:31:10.780449 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:31:10.788788 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-8c34ca81-4143-4832-b551-7ae43a862266 req-b9e3772b-9b90-42ac-8ccf-020b09f0f722 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:10.789206 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-8c34ca81-4143-4832-b551-7ae43a862266 req-b9e3772b-9b90-42ac-8ccf-020b09f0f722 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:10.802012 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-8c34ca81-4143-4832-b551-7ae43a862266 req-b9e3772b-9b90-42ac-8ccf-020b09f0f722 service nova] Creating event network-vif-deleted:b84a1600-9302-43ac-8004-61bd10577802 for instance c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb on hv-cinder-80447 Feb 21 02:31:10.808934 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-8c34ca81-4143-4832-b551-7ae43a862266 req-b9e3772b-9b90-42ac-8ccf-020b09f0f722 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Feb 21 02:31:10.810615 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 302/585] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:31:10.868462 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ea291a10-6345-4453-a536-4e485e642c09 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:10.876250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ea291a10-6345-4453-a536-4e485e642c09 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 200 len: 1507 microversion: 2.1 time: 0.566216 Feb 21 02:31:10.876894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 284/586] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:10 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:11.244794 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:11.246122 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:11.253989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:11.255169 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:11.256322 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:11.256924 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:11.292293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:11.292748 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:11.293202 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:31:11.338011 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:11.345977 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-12d85094-4c11-4256-b4db-d1766271ec2d tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 200 len: 1307 microversion: 2.1 time: 0.105935 Feb 21 02:31:11.356130 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 303/587] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:11 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:11.891916 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:11.892878 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: c909020c-1e47-4a5c-826f-c8d88b2c7a05] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:11.899145 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:11.899905 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:11.901054 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:11.901502 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:11.915050 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] HTTP exception thrown: Instance c909020c-1e47-4a5c-826f-c8d88b2c7a05 could not be found. Feb 21 02:31:11.915628 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Returning 404 to user: Instance c909020c-1e47-4a5c-826f-c8d88b2c7a05 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:31:11.916439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-65c70c4b-a0b9-4bb3-bda0-85453e2ac329 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05" status: 404 len: 111 microversion: 2.1 time: 0.028159 Feb 21 02:31:11.916964 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 285/588] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:11 2022] GET /compute/v2.1/servers/c909020c-1e47-4a5c-826f-c8d88b2c7a05 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:31:11.925587 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e03d03cb-3621-4830-a717-c6a86d3257cd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:11.926148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e03d03cb-3621-4830-a717-c6a86d3257cd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:11.931852 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e03d03cb-3621-4830-a717-c6a86d3257cd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:11.932300 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e03d03cb-3621-4830-a717-c6a86d3257cd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:11.933063 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e03d03cb-3621-4830-a717-c6a86d3257cd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:11.933489 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e03d03cb-3621-4830-a717-c6a86d3257cd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:11.960496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e03d03cb-3621-4830-a717-c6a86d3257cd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:31:12.031837 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e03d03cb-3621-4830-a717-c6a86d3257cd tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 204 len: 0 microversion: 2.1 time: 0.110362 Feb 21 02:31:12.032416 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 304/589] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:31:11 2022] DELETE /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:31:12.041958 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-17cfbcdb-1e45-4e75-ad9e-d7dcecc3b852 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:12.042830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-17cfbcdb-1e45-4e75-ad9e-d7dcecc3b852 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:12.049477 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17cfbcdb-1e45-4e75-ad9e-d7dcecc3b852 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:12.049956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17cfbcdb-1e45-4e75-ad9e-d7dcecc3b852 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:12.050734 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17cfbcdb-1e45-4e75-ad9e-d7dcecc3b852 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:12.051171 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17cfbcdb-1e45-4e75-ad9e-d7dcecc3b852 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:12.182627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-17cfbcdb-1e45-4e75-ad9e-d7dcecc3b852 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:12.190966 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-17cfbcdb-1e45-4e75-ad9e-d7dcecc3b852 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.152761 Feb 21 02:31:12.191531 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 286/590] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:12 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:12.365163 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:12.365791 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:12.372165 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:12.372610 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:12.373387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:12.373857 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:12.386923 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] HTTP exception thrown: Instance c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb could not be found. Feb 21 02:31:12.387490 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Returning 404 to user: Instance c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:31:12.388299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ec294239-2b84-4a44-806c-581fe9ae929b tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb" status: 404 len: 111 microversion: 2.1 time: 0.027824 Feb 21 02:31:12.388822 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 305/591] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:12 2022] GET /compute/v2.1/servers/c3d170bc-302a-4ea8-a3b4-20b7d4bec6fb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:31:12.834354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-f46ed623-da46-4304-b643-04832fbaf2ea req-5ab4faa3-3534-4580-8bb3-8ca8f0d5f12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c909020c-1e47-4a5c-826f-c8d88b2c7a05", "name": "network-vif-deleted", "tag": "10b7d237-63f4-46b8-9fb5-022ff16a013d"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:12.835894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:31:12.835894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:31:12.842677 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-f46ed623-da46-4304-b643-04832fbaf2ea req-5ab4faa3-3534-4580-8bb3-8ca8f0d5f12d service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:12.843110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-f46ed623-da46-4304-b643-04832fbaf2ea req-5ab4faa3-3534-4580-8bb3-8ca8f0d5f12d service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:12.853885 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-f46ed623-da46-4304-b643-04832fbaf2ea req-5ab4faa3-3534-4580-8bb3-8ca8f0d5f12d service nova] Creating event network-vif-deleted:10b7d237-63f4-46b8-9fb5-022ff16a013d for instance c909020c-1e47-4a5c-826f-c8d88b2c7a05 on hv-cinder-80447 Feb 21 02:31:12.858855 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-f46ed623-da46-4304-b643-04832fbaf2ea req-5ab4faa3-3534-4580-8bb3-8ca8f0d5f12d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028173 Feb 21 02:31:12.859416 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 287/592] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:31:13.208207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9e7ab60a-d50e-4884-9116-97043df6cdc7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:13.208807 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9e7ab60a-d50e-4884-9116-97043df6cdc7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:13.214624 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9e7ab60a-d50e-4884-9116-97043df6cdc7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:13.215061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9e7ab60a-d50e-4884-9116-97043df6cdc7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:13.215824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9e7ab60a-d50e-4884-9116-97043df6cdc7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:13.216253 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9e7ab60a-d50e-4884-9116-97043df6cdc7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:13.353172 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9e7ab60a-d50e-4884-9116-97043df6cdc7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:13.361277 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9e7ab60a-d50e-4884-9116-97043df6cdc7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.156672 Feb 21 02:31:13.362303 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 306/593] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:13 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:14.380010 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8b23527c-f86a-4324-8732-e6865120514a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:14.381627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8b23527c-f86a-4324-8732-e6865120514a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:14.393834 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8b23527c-f86a-4324-8732-e6865120514a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:14.394283 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8b23527c-f86a-4324-8732-e6865120514a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:14.395067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8b23527c-f86a-4324-8732-e6865120514a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:14.395501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8b23527c-f86a-4324-8732-e6865120514a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:14.551603 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8b23527c-f86a-4324-8732-e6865120514a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:14.559377 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8b23527c-f86a-4324-8732-e6865120514a tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.184940 Feb 21 02:31:14.560034 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 288/594] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:14 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:15.576867 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-56ceb0e6-900c-4be0-895f-272cf0d013b7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:15.577506 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-56ceb0e6-900c-4be0-895f-272cf0d013b7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:15.583741 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-56ceb0e6-900c-4be0-895f-272cf0d013b7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:15.584190 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-56ceb0e6-900c-4be0-895f-272cf0d013b7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:15.584968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-56ceb0e6-900c-4be0-895f-272cf0d013b7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:15.585407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-56ceb0e6-900c-4be0-895f-272cf0d013b7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:15.719124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-56ceb0e6-900c-4be0-895f-272cf0d013b7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:15.727101 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-56ceb0e6-900c-4be0-895f-272cf0d013b7 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.153835 Feb 21 02:31:15.727667 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 307/595] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:15 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:16.744439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6497c029-1fd9-4ac1-8c59-2d335f205baf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:16.745178 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6497c029-1fd9-4ac1-8c59-2d335f205baf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:16.752035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6497c029-1fd9-4ac1-8c59-2d335f205baf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:16.752481 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6497c029-1fd9-4ac1-8c59-2d335f205baf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:16.753257 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6497c029-1fd9-4ac1-8c59-2d335f205baf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:16.753711 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6497c029-1fd9-4ac1-8c59-2d335f205baf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:16.895641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6497c029-1fd9-4ac1-8c59-2d335f205baf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:16.902858 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6497c029-1fd9-4ac1-8c59-2d335f205baf tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.162282 Feb 21 02:31:16.903414 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 289/596] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:16 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:17.919435 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b68a4371-f53f-4ca4-9f22-937ec6935afc tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:17.920041 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b68a4371-f53f-4ca4-9f22-937ec6935afc tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:17.925876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b68a4371-f53f-4ca4-9f22-937ec6935afc tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:17.926321 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b68a4371-f53f-4ca4-9f22-937ec6935afc tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:17.927090 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b68a4371-f53f-4ca4-9f22-937ec6935afc tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:17.927521 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b68a4371-f53f-4ca4-9f22-937ec6935afc tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:18.058861 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b68a4371-f53f-4ca4-9f22-937ec6935afc tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:18.066239 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b68a4371-f53f-4ca4-9f22-937ec6935afc tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.150546 Feb 21 02:31:18.066804 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 308/597] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:17 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:18.158607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5e4367e3-14b9-485f-91db-2c4d0f0bb1a1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "896b4051-2e61-40c0-a16c-34f6fd542bf4"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:18.159653 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5e4367e3-14b9-485f-91db-2c4d0f0bb1a1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:18.165879 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5e4367e3-14b9-485f-91db-2c4d0f0bb1a1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:18.166327 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5e4367e3-14b9-485f-91db-2c4d0f0bb1a1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:18.167095 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5e4367e3-14b9-485f-91db-2c4d0f0bb1a1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:18.167526 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5e4367e3-14b9-485f-91db-2c4d0f0bb1a1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:19.082692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5b2f4771-0d1d-4b2d-b7f1-fccbcd8b5035 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:19.083208 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5b2f4771-0d1d-4b2d-b7f1-fccbcd8b5035 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:19.089439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5b2f4771-0d1d-4b2d-b7f1-fccbcd8b5035 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:19.089926 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5b2f4771-0d1d-4b2d-b7f1-fccbcd8b5035 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:19.090692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5b2f4771-0d1d-4b2d-b7f1-fccbcd8b5035 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:19.091122 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5b2f4771-0d1d-4b2d-b7f1-fccbcd8b5035 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:19.221844 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5b2f4771-0d1d-4b2d-b7f1-fccbcd8b5035 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:19.229444 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5b2f4771-0d1d-4b2d-b7f1-fccbcd8b5035 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.150433 Feb 21 02:31:19.230033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 309/598] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:19 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:20.247017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3d8ab306-5ecf-4782-8072-25d22655be04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:20.247714 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3d8ab306-5ecf-4782-8072-25d22655be04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:20.254500 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3d8ab306-5ecf-4782-8072-25d22655be04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:20.254945 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3d8ab306-5ecf-4782-8072-25d22655be04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:20.255738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3d8ab306-5ecf-4782-8072-25d22655be04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:20.256168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3d8ab306-5ecf-4782-8072-25d22655be04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:20.387399 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3d8ab306-5ecf-4782-8072-25d22655be04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:20.394911 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3d8ab306-5ecf-4782-8072-25d22655be04 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.151558 Feb 21 02:31:20.395468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 310/599] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:20 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:21.148761 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5e4367e3-14b9-485f-91db-2c4d0f0bb1a1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.993622 Feb 21 02:31:21.149438 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 290/600] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:31:18 2022] POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/os-volume_attachments => generated 194 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:31:21.412256 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c1967002-0396-46c7-a684-b3fe5600ed77 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:21.412793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c1967002-0396-46c7-a684-b3fe5600ed77 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:21.418964 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c1967002-0396-46c7-a684-b3fe5600ed77 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:21.419408 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c1967002-0396-46c7-a684-b3fe5600ed77 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:21.420171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c1967002-0396-46c7-a684-b3fe5600ed77 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:21.420603 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c1967002-0396-46c7-a684-b3fe5600ed77 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:21.556177 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c1967002-0396-46c7-a684-b3fe5600ed77 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:21.563437 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c1967002-0396-46c7-a684-b3fe5600ed77 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.154855 Feb 21 02:31:21.564385 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 311/601] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:21 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:22.580943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-76800f07-9c4e-448b-8c3e-8e68e99cb098 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:22.581785 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-76800f07-9c4e-448b-8c3e-8e68e99cb098 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:22.588471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-76800f07-9c4e-448b-8c3e-8e68e99cb098 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:22.588912 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-76800f07-9c4e-448b-8c3e-8e68e99cb098 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:22.589718 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-76800f07-9c4e-448b-8c3e-8e68e99cb098 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:22.590137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-76800f07-9c4e-448b-8c3e-8e68e99cb098 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:22.824444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-76800f07-9c4e-448b-8c3e-8e68e99cb098 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:22.831925 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-76800f07-9c4e-448b-8c3e-8e68e99cb098 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1521 microversion: 2.1 time: 0.255674 Feb 21 02:31:22.832597 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 291/602] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:22 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:22.932898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-099af005-be01-4dbc-a0fe-3cab40823873 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:22.933470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-099af005-be01-4dbc-a0fe-3cab40823873 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:22.939859 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-099af005-be01-4dbc-a0fe-3cab40823873 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:22.940373 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-099af005-be01-4dbc-a0fe-3cab40823873 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:22.941322 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-099af005-be01-4dbc-a0fe-3cab40823873 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:22.941868 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-099af005-be01-4dbc-a0fe-3cab40823873 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:22.974133 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-099af005-be01-4dbc-a0fe-3cab40823873 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:31:23.057528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-099af005-be01-4dbc-a0fe-3cab40823873 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 204 len: 0 microversion: 2.1 time: 0.127817 Feb 21 02:31:23.058653 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 312/603] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:31:22 2022] DELETE /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 02:31:23.066581 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-471468e1-4d95-4957-9e19-2807d6667905 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:23.067214 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-471468e1-4d95-4957-9e19-2807d6667905 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:23.074507 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-471468e1-4d95-4957-9e19-2807d6667905 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:23.074952 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-471468e1-4d95-4957-9e19-2807d6667905 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:23.075733 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-471468e1-4d95-4957-9e19-2807d6667905 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:23.076161 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-471468e1-4d95-4957-9e19-2807d6667905 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:23.255107 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-e12e0ce4-a53d-4473-979c-ff19444959ca req-6be3e816-6ae3-467f-8cbe-194ec5e2681e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aeae50f-fa12-4250-8e53-9a5fcdded6d3", "name": "network-vif-deleted", "tag": "71ba9208-2448-4764-bb34-2672da8a2c21"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:23.256892 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:31:23.256892 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:31:23.279281 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-e12e0ce4-a53d-4473-979c-ff19444959ca req-6be3e816-6ae3-467f-8cbe-194ec5e2681e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:23.279728 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-e12e0ce4-a53d-4473-979c-ff19444959ca req-6be3e816-6ae3-467f-8cbe-194ec5e2681e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:23.300297 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-e12e0ce4-a53d-4473-979c-ff19444959ca req-6be3e816-6ae3-467f-8cbe-194ec5e2681e service nova] Creating event network-vif-deleted:71ba9208-2448-4764-bb34-2672da8a2c21 for instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 on hv-cinder-80447 Feb 21 02:31:23.304200 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-471468e1-4d95-4957-9e19-2807d6667905 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:23.312008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-471468e1-4d95-4957-9e19-2807d6667905 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1513 microversion: 2.1 time: 0.249069 Feb 21 02:31:23.312567 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 292/604] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:23 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:23.323685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-e12e0ce4-a53d-4473-979c-ff19444959ca req-6be3e816-6ae3-467f-8cbe-194ec5e2681e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072734 Feb 21 02:31:23.324629 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 313/605] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:31:23.848517 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:23.849126 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:23.855236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:23.855676 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:23.856436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:23.856860 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:23.886775 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:23.887234 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:23.887676 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lazy-loading 'fault' on Instance uuid 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:31:23.929428 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:23.936699 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-062da655-5eeb-4aa9-b07b-bb34e659356e tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1312 microversion: 2.1 time: 0.092541 Feb 21 02:31:23.937316 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 293/606] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:23 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:24.330868 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8a545197-c3bf-4c2a-8819-6929f1010fe4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:24.331578 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8a545197-c3bf-4c2a-8819-6929f1010fe4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:24.337881 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8a545197-c3bf-4c2a-8819-6929f1010fe4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:24.338328 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8a545197-c3bf-4c2a-8819-6929f1010fe4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:24.339175 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8a545197-c3bf-4c2a-8819-6929f1010fe4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:24.339603 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8a545197-c3bf-4c2a-8819-6929f1010fe4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:24.469903 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8a545197-c3bf-4c2a-8819-6929f1010fe4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:24.477226 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8a545197-c3bf-4c2a-8819-6929f1010fe4 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1513 microversion: 2.1 time: 0.152046 Feb 21 02:31:24.477805 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 314/607] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:24 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:24.953451 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:24.954655 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:24.960888 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:24.961330 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:24.962124 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:24.962558 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:24.992005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:24.992447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:24.992883 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lazy-loading 'fault' on Instance uuid 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:31:25.032094 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:25.039390 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-15b3d676-4ce4-43af-bef1-8fcc0ed1f4b4 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1312 microversion: 2.1 time: 0.089573 Feb 21 02:31:25.039944 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 294/608] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:24 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:25.494472 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9b8697c7-293a-46ea-a33c-0a076bf55bbf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:25.495082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9b8697c7-293a-46ea-a33c-0a076bf55bbf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:25.502383 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9b8697c7-293a-46ea-a33c-0a076bf55bbf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:25.502863 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9b8697c7-293a-46ea-a33c-0a076bf55bbf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:25.503643 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9b8697c7-293a-46ea-a33c-0a076bf55bbf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:25.504249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9b8697c7-293a-46ea-a33c-0a076bf55bbf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:25.639473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9b8697c7-293a-46ea-a33c-0a076bf55bbf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:25.647161 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9b8697c7-293a-46ea-a33c-0a076bf55bbf tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1513 microversion: 2.1 time: 0.156353 Feb 21 02:31:25.647723 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 315/609] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:25 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:26.055739 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:26.056340 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:26.062487 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:26.062925 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:26.063820 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:26.064255 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:26.095781 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:26.096217 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:26.096650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lazy-loading 'fault' on Instance uuid 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:31:26.134487 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca2ee69b3d3347819e45881ef8ad5ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a6242d1dd24262be9852a4a5b1523d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:26.141428 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6fca25d9-ea67-4171-a68a-c5e300ca871d tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 200 len: 1312 microversion: 2.1 time: 0.089293 Feb 21 02:31:26.142646 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 295/610] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:26 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:26.663866 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a9a85560-8c53-4864-84fb-b212c4d73e9f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:26.664464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a9a85560-8c53-4864-84fb-b212c4d73e9f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:26.670940 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a9a85560-8c53-4864-84fb-b212c4d73e9f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:26.671396 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a9a85560-8c53-4864-84fb-b212c4d73e9f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:26.672181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a9a85560-8c53-4864-84fb-b212c4d73e9f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:26.672622 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a9a85560-8c53-4864-84fb-b212c4d73e9f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:26.804128 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a9a85560-8c53-4864-84fb-b212c4d73e9f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:26.811487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a9a85560-8c53-4864-84fb-b212c4d73e9f tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1513 microversion: 2.1 time: 0.151294 Feb 21 02:31:26.812048 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 316/611] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:26 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:27.158717 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:27.159309 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] [instance: 8aeae50f-fa12-4250-8e53-9a5fcdded6d3] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:27.165435 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:27.165914 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:27.166669 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:27.167091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:27.180249 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] HTTP exception thrown: Instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 could not be found. Feb 21 02:31:27.180807 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] Returning 404 to user: Instance 8aeae50f-fa12-4250-8e53-9a5fcdded6d3 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:31:27.181599 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-abdb7031-eef5-4914-bdd3-5e00f97ff124 tempest-ServerRescueNegativeTestJSON-1487863988 tempest-ServerRescueNegativeTestJSON-1487863988-project] 10.222.0.75 "GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3" status: 404 len: 111 microversion: 2.1 time: 0.026996 Feb 21 02:31:27.182132 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 296/612] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:27 2022] GET /compute/v2.1/servers/8aeae50f-fa12-4250-8e53-9a5fcdded6d3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:31:27.828054 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-99647ac5-1bee-46d1-b8c8-543302b5d64c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:27.828666 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-99647ac5-1bee-46d1-b8c8-543302b5d64c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:27.835787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99647ac5-1bee-46d1-b8c8-543302b5d64c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:27.836227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99647ac5-1bee-46d1-b8c8-543302b5d64c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:27.837004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99647ac5-1bee-46d1-b8c8-543302b5d64c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:27.837432 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-99647ac5-1bee-46d1-b8c8-543302b5d64c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:28.024712 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-99647ac5-1bee-46d1-b8c8-543302b5d64c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:28.031918 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-99647ac5-1bee-46d1-b8c8-543302b5d64c tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1513 microversion: 2.1 time: 0.207515 Feb 21 02:31:28.032503 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 317/613] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:27 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:29.048809 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1169cb9f-e4d0-4f4a-b938-bb24b03559ad tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:29.050256 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1169cb9f-e4d0-4f4a-b938-bb24b03559ad tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:29.058136 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1169cb9f-e4d0-4f4a-b938-bb24b03559ad tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:29.059077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1169cb9f-e4d0-4f4a-b938-bb24b03559ad tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:29.060370 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1169cb9f-e4d0-4f4a-b938-bb24b03559ad tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:29.061210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1169cb9f-e4d0-4f4a-b938-bb24b03559ad tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:29.326406 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1169cb9f-e4d0-4f4a-b938-bb24b03559ad tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:29.343469 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1169cb9f-e4d0-4f4a-b938-bb24b03559ad tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1513 microversion: 2.1 time: 0.298919 Feb 21 02:31:29.344015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 297/614] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:29 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:30.360344 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dab5c9a7-2861-44ef-bcbc-a24ea8b8de74 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:30.361113 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dab5c9a7-2861-44ef-bcbc-a24ea8b8de74 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:30.373147 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dab5c9a7-2861-44ef-bcbc-a24ea8b8de74 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:30.373864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dab5c9a7-2861-44ef-bcbc-a24ea8b8de74 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:30.374849 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dab5c9a7-2861-44ef-bcbc-a24ea8b8de74 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:30.375447 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dab5c9a7-2861-44ef-bcbc-a24ea8b8de74 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:30.560620 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-dab5c9a7-2861-44ef-bcbc-a24ea8b8de74 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:30.571800 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dab5c9a7-2861-44ef-bcbc-a24ea8b8de74 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1513 microversion: 2.1 time: 0.215215 Feb 21 02:31:30.572613 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 318/615] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:30 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:30.839182 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0534ec47-bb70-492f-883d-314bf2b6ae3f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:30.859325 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0534ec47-bb70-492f-883d-314bf2b6ae3f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:30.859579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0534ec47-bb70-492f-883d-314bf2b6ae3f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:30.931599 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0534ec47-bb70-492f-883d-314bf2b6ae3f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Going to try to stop instance {{(pid=116710) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 02:31:31.002465 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0534ec47-bb70-492f-883d-314bf2b6ae3f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/action" status: 202 len: 0 microversion: 2.1 time: 0.165536 Feb 21 02:31:31.003344 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 298/616] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:31:30 2022] POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:31:31.013095 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2dbe088d-8187-430c-93ca-69994487d8c1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:31.014363 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2dbe088d-8187-430c-93ca-69994487d8c1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:31.026006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2dbe088d-8187-430c-93ca-69994487d8c1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:31.026754 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2dbe088d-8187-430c-93ca-69994487d8c1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:31.028652 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2dbe088d-8187-430c-93ca-69994487d8c1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:31.029298 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2dbe088d-8187-430c-93ca-69994487d8c1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:31.186183 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2dbe088d-8187-430c-93ca-69994487d8c1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:31.195692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2dbe088d-8187-430c-93ca-69994487d8c1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.187563 Feb 21 02:31:31.196411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 319/617] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:31 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:31.241440 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-f508cd48-709e-4a02-9bc3-f7b6c3083564 req-3186b216-411e-4f88-9b9f-3d25473b5cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2034fae-347a-4500-8cbf-606b03dcfcc5", "name": "network-vif-deleted", "tag": "2460a313-d85b-438c-8bd0-f46e5ebbd9ff"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:31.243243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:31:31.243243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:31:31.252919 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-f508cd48-709e-4a02-9bc3-f7b6c3083564 req-3186b216-411e-4f88-9b9f-3d25473b5cb4 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:31.253689 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-f508cd48-709e-4a02-9bc3-f7b6c3083564 req-3186b216-411e-4f88-9b9f-3d25473b5cb4 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:31.266579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-f508cd48-709e-4a02-9bc3-f7b6c3083564 req-3186b216-411e-4f88-9b9f-3d25473b5cb4 service nova] Creating event network-vif-deleted:2460a313-d85b-438c-8bd0-f46e5ebbd9ff for instance f2034fae-347a-4500-8cbf-606b03dcfcc5 on hv-cinder-80447 Feb 21 02:31:31.272637 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-f508cd48-709e-4a02-9bc3-f7b6c3083564 req-3186b216-411e-4f88-9b9f-3d25473b5cb4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035849 Feb 21 02:31:31.273523 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 299/618] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:31:31.588571 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:31.589341 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:31.596420 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:31.597037 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:31.598010 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:31.598441 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:31.638415 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:31.639470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:31.640141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lazy-loading 'fault' on Instance uuid f2034fae-347a-4500-8cbf-606b03dcfcc5 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:31:31.699503 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533f0f53f5504f0caec419a41f0f7452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440cb05903bb427baa54dbe25b56ee7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:31.710525 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a4a7e8ba-260d-436e-a02a-e9c9d41a6dc7 tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 200 len: 1308 microversion: 2.1 time: 0.125471 Feb 21 02:31:31.711798 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 320/619] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:31 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:32.214961 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4adcce19-1bcd-440e-ba80-1d34523ac08e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:32.215724 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4adcce19-1bcd-440e-ba80-1d34523ac08e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:32.222613 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4adcce19-1bcd-440e-ba80-1d34523ac08e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:32.223056 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4adcce19-1bcd-440e-ba80-1d34523ac08e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:32.223829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4adcce19-1bcd-440e-ba80-1d34523ac08e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:32.224420 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4adcce19-1bcd-440e-ba80-1d34523ac08e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:32.420281 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4adcce19-1bcd-440e-ba80-1d34523ac08e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:32.429355 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4adcce19-1bcd-440e-ba80-1d34523ac08e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.218683 Feb 21 02:31:32.430227 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 300/620] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:32 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:32.728210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:32.728831 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] [instance: f2034fae-347a-4500-8cbf-606b03dcfcc5] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:32.735944 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:32.736445 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:32.737287 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:32.737827 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:32.751384 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] HTTP exception thrown: Instance f2034fae-347a-4500-8cbf-606b03dcfcc5 could not be found. Feb 21 02:31:32.752141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] Returning 404 to user: Instance f2034fae-347a-4500-8cbf-606b03dcfcc5 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:31:32.753402 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fa948bfc-029d-464f-98ea-5b4bc0c78a7e tempest-AttachVolumeNegativeTest-824279598 tempest-AttachVolumeNegativeTest-824279598-project] 10.222.0.75 "GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5" status: 404 len: 111 microversion: 2.1 time: 0.029001 Feb 21 02:31:32.754192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 321/621] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:32 2022] GET /compute/v2.1/servers/f2034fae-347a-4500-8cbf-606b03dcfcc5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:31:32.775726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bf0fee4c-3098-4879-a594-ceb095121a9a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:32.776524 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bf0fee4c-3098-4879-a594-ceb095121a9a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:32.783471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf0fee4c-3098-4879-a594-ceb095121a9a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:32.784841 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf0fee4c-3098-4879-a594-ceb095121a9a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:32.785911 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf0fee4c-3098-4879-a594-ceb095121a9a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:32.786416 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf0fee4c-3098-4879-a594-ceb095121a9a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:32.900839 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-bf0fee4c-3098-4879-a594-ceb095121a9a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lazy-loading 'services' on Instance uuid 9ecd84e6-18a9-4335-8476-507d531cda92 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:31:33.020709 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bf0fee4c-3098-4879-a594-ceb095121a9a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92/os-volume_attachments/06ff58ba-9038-441b-9363-c29229aa2437" status: 202 len: 0 microversion: 2.1 time: 0.248333 Feb 21 02:31:33.021549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 301/622] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:31:32 2022] DELETE /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92/os-volume_attachments/06ff58ba-9038-441b-9363-c29229aa2437 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:31:33.447298 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-aa76f9ac-685f-4bae-acac-dfe099f7d20e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:33.448018 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-aa76f9ac-685f-4bae-acac-dfe099f7d20e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:33.471381 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aa76f9ac-685f-4bae-acac-dfe099f7d20e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:33.472623 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aa76f9ac-685f-4bae-acac-dfe099f7d20e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:33.473599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aa76f9ac-685f-4bae-acac-dfe099f7d20e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:33.474579 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-aa76f9ac-685f-4bae-acac-dfe099f7d20e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:33.756642 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-aa76f9ac-685f-4bae-acac-dfe099f7d20e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:33.764554 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-aa76f9ac-685f-4bae-acac-dfe099f7d20e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.320951 Feb 21 02:31:33.765317 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 322/623] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:33 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:34.190007 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-92b9a208-07a5-437c-9d53-a7b87ff1ff0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:34.190594 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-92b9a208-07a5-437c-9d53-a7b87ff1ff0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:34.197047 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-92b9a208-07a5-437c-9d53-a7b87ff1ff0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:34.197490 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-92b9a208-07a5-437c-9d53-a7b87ff1ff0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:34.198300 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-92b9a208-07a5-437c-9d53-a7b87ff1ff0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:34.198775 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-92b9a208-07a5-437c-9d53-a7b87ff1ff0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:34.226276 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-92b9a208-07a5-437c-9d53-a7b87ff1ff0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:31:34.325923 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-92b9a208-07a5-437c-9d53-a7b87ff1ff0d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 204 len: 0 microversion: 2.1 time: 0.140200 Feb 21 02:31:34.326606 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 302/624] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:31:34 2022] DELETE /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:31:34.336302 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e3a438c5-19d9-4632-bef8-1308f9253e59 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:34.337059 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e3a438c5-19d9-4632-bef8-1308f9253e59 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:34.343036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3a438c5-19d9-4632-bef8-1308f9253e59 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:34.343600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3a438c5-19d9-4632-bef8-1308f9253e59 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:34.345744 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3a438c5-19d9-4632-bef8-1308f9253e59 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:34.346384 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3a438c5-19d9-4632-bef8-1308f9253e59 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:34.782974 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e43b969e-77bd-4dcf-9b5f-bb02cfdedf81 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:34.783899 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e43b969e-77bd-4dcf-9b5f-bb02cfdedf81 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:34.789904 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e43b969e-77bd-4dcf-9b5f-bb02cfdedf81 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:34.790563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e43b969e-77bd-4dcf-9b5f-bb02cfdedf81 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:34.791515 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e43b969e-77bd-4dcf-9b5f-bb02cfdedf81 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:34.792146 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e43b969e-77bd-4dcf-9b5f-bb02cfdedf81 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:34.852586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e3a438c5-19d9-4632-bef8-1308f9253e59 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:34.881398 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e3a438c5-19d9-4632-bef8-1308f9253e59 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1513 microversion: 2.1 time: 0.549210 Feb 21 02:31:34.886948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 323/625] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:34 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1513 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:34.981536 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e43b969e-77bd-4dcf-9b5f-bb02cfdedf81 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:34.995185 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e43b969e-77bd-4dcf-9b5f-bb02cfdedf81 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.216317 Feb 21 02:31:35.013596 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 303/626] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:34 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:35.905999 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-500f3420-5878-4699-b52c-6f41a877660d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:35.908361 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-500f3420-5878-4699-b52c-6f41a877660d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:35.935044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-500f3420-5878-4699-b52c-6f41a877660d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:35.935514 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-500f3420-5878-4699-b52c-6f41a877660d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:35.937144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-500f3420-5878-4699-b52c-6f41a877660d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:35.938765 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-500f3420-5878-4699-b52c-6f41a877660d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:36.021104 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7560ca38-7303-4a13-bb01-639ed10b2578 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:36.021842 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7560ca38-7303-4a13-bb01-639ed10b2578 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:36.033044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7560ca38-7303-4a13-bb01-639ed10b2578 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:36.035179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7560ca38-7303-4a13-bb01-639ed10b2578 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:36.037442 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7560ca38-7303-4a13-bb01-639ed10b2578 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:36.039105 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7560ca38-7303-4a13-bb01-639ed10b2578 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:36.147311 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-500f3420-5878-4699-b52c-6f41a877660d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:36.155668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-500f3420-5878-4699-b52c-6f41a877660d tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1513 microversion: 2.1 time: 0.254678 Feb 21 02:31:36.172116 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 324/627] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:35 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:36.312171 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7560ca38-7303-4a13-bb01-639ed10b2578 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:36.327157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7560ca38-7303-4a13-bb01-639ed10b2578 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.308337 Feb 21 02:31:36.327972 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 304/628] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:36 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:37.192539 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c19b86a5-1f8e-4ead-807a-968e60f8474a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:37.196306 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c19b86a5-1f8e-4ead-807a-968e60f8474a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:37.212149 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c19b86a5-1f8e-4ead-807a-968e60f8474a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:37.215474 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c19b86a5-1f8e-4ead-807a-968e60f8474a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:37.217084 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c19b86a5-1f8e-4ead-807a-968e60f8474a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:37.217986 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c19b86a5-1f8e-4ead-807a-968e60f8474a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:37.345103 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-63badee1-23bd-4336-94b4-fd46c28625bc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:37.345742 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-63badee1-23bd-4336-94b4-fd46c28625bc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:37.352433 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c19b86a5-1f8e-4ead-807a-968e60f8474a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:37.352597 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-63badee1-23bd-4336-94b4-fd46c28625bc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:37.352943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-63badee1-23bd-4336-94b4-fd46c28625bc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:37.353766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-63badee1-23bd-4336-94b4-fd46c28625bc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:37.354208 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-63badee1-23bd-4336-94b4-fd46c28625bc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:37.360313 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c19b86a5-1f8e-4ead-807a-968e60f8474a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 200 len: 1471 microversion: 2.1 time: 0.179723 Feb 21 02:31:37.361415 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 325/629] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:37 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:37.390346 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-26a19292-7d4c-4395-8278-6601a9840930 req-3f4d80e5-f5dd-4cce-ab97-93c9404e40ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ecd84e6-18a9-4335-8476-507d531cda92", "name": "network-vif-deleted", "tag": "2021a41e-916a-4ed6-a694-a01cc08dc51c"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:37.392596 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:31:37.392596 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:31:37.408847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-26a19292-7d4c-4395-8278-6601a9840930 req-3f4d80e5-f5dd-4cce-ab97-93c9404e40ed service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:37.412476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-26a19292-7d4c-4395-8278-6601a9840930 req-3f4d80e5-f5dd-4cce-ab97-93c9404e40ed service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:37.440586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-26a19292-7d4c-4395-8278-6601a9840930 req-3f4d80e5-f5dd-4cce-ab97-93c9404e40ed service nova] Creating event network-vif-deleted:2021a41e-916a-4ed6-a694-a01cc08dc51c for instance 9ecd84e6-18a9-4335-8476-507d531cda92 on hv-cinder-80447 Feb 21 02:31:37.446719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-26a19292-7d4c-4395-8278-6601a9840930 req-3f4d80e5-f5dd-4cce-ab97-93c9404e40ed service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060168 Feb 21 02:31:37.447323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 326/630] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:31:37.791455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-63badee1-23bd-4336-94b4-fd46c28625bc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:37.808378 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-63badee1-23bd-4336-94b4-fd46c28625bc tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.466804 Feb 21 02:31:37.810066 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 305/631] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:37 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:38.164757 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-938fd190-d8ad-4e21-ba64-a9806608a126 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'create', calling method: .version_select at 0x7fd85c09fdc0>, body: {"keypair": {"name": "tempest-keypair-1674768771"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:38.187769 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-938fd190-d8ad-4e21-ba64-a9806608a126 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:31:38.193328 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-938fd190-d8ad-4e21-ba64-a9806608a126 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for user fe4f394cc0a14d4e98d173a0f081bb8c and project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:31:38.377635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:38.378269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: 9ecd84e6-18a9-4335-8476-507d531cda92] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:38.385586 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:38.386381 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:38.387497 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:38.388095 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:38.409455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] HTTP exception thrown: Instance 9ecd84e6-18a9-4335-8476-507d531cda92 could not be found. Feb 21 02:31:38.410233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Returning 404 to user: Instance 9ecd84e6-18a9-4335-8476-507d531cda92 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:31:38.411377 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5d6a52f4-fa38-4f33-bb46-263f12c27d18 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92" status: 404 len: 111 microversion: 2.1 time: 0.037788 Feb 21 02:31:38.417872 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 306/632] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:38 2022] GET /compute/v2.1/servers/9ecd84e6-18a9-4335-8476-507d531cda92 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 02:31:38.527623 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-938fd190-d8ad-4e21-ba64-a9806608a126 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:31:38.533482 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-938fd190-d8ad-4e21-ba64-a9806608a126 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for user fe4f394cc0a14d4e98d173a0f081bb8c and project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:31:38.547993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-938fd190-d8ad-4e21-ba64-a9806608a126 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.555831 Feb 21 02:31:38.548590 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 327/633] 10.222.0.75 () {62 vars in 1198 bytes} [Mon Feb 21 02:31:37 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 557 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 21 02:31:38.826833 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d7f0e20a-a0d0-425e-a4e6-ff9f64c2a717 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:38.827457 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d7f0e20a-a0d0-425e-a4e6-ff9f64c2a717 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:38.839591 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d7f0e20a-a0d0-425e-a4e6-ff9f64c2a717 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:38.840460 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d7f0e20a-a0d0-425e-a4e6-ff9f64c2a717 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:38.841689 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d7f0e20a-a0d0-425e-a4e6-ff9f64c2a717 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:38.842373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d7f0e20a-a0d0-425e-a4e6-ff9f64c2a717 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:39.377634 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d7f0e20a-a0d0-425e-a4e6-ff9f64c2a717 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:39.387871 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d7f0e20a-a0d0-425e-a4e6-ff9f64c2a717 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.564686 Feb 21 02:31:39.390537 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 307/634] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:38 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:40.202123 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1222937309", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aed7eff0-82e8-4eca-ade5-d5275418c168"}], "security_groups": [{"name": "tempest-securitygroup--1577879799"}], "key_name": "tempest-keypair-1674768771", "user_data": "}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:40.315057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] validate_networks() for [('aed7eff0-82e8-4eca-ade5-d5275418c168', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:31:40.407443 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1c827fb5-c87c-4781-9c04-4830648340b3 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:40.408665 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1c827fb5-c87c-4781-9c04-4830648340b3 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:40.415214 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1c827fb5-c87c-4781-9c04-4830648340b3 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:40.415668 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1c827fb5-c87c-4781-9c04-4830648340b3 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:40.416459 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1c827fb5-c87c-4781-9c04-4830648340b3 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:40.416895 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1c827fb5-c87c-4781-9c04-4830648340b3 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:40.664078 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1c827fb5-c87c-4781-9c04-4830648340b3 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:40.674601 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1c827fb5-c87c-4781-9c04-4830648340b3 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.271229 Feb 21 02:31:40.687660 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 308/635] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:40 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:40.773389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:31:40.773828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:31:40.774293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:31:40.774805 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:31:40.775212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:31:40.785585 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:40.786150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:40.787046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:40.787555 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:40.804210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:31:40.808255 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for user fe4f394cc0a14d4e98d173a0f081bb8c and project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:31:40.821909 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:31:40.824428 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:31:40.877544 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0f6a0700-ba1b-4b4c-91fa-ec96726f96e9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.679905 Feb 21 02:31:40.878980 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 328/636] 10.222.0.75 () {62 vars in 1187 bytes} [Mon Feb 21 02:31:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 21 02:31:40.889425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-133b8c5c-0c45-41a2-a156-98cc1f110a32 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:40.890124 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-133b8c5c-0c45-41a2-a156-98cc1f110a32 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:40.994597 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-133b8c5c-0c45-41a2-a156-98cc1f110a32 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:41.009233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-133b8c5c-0c45-41a2-a156-98cc1f110a32 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:41.015303 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-133b8c5c-0c45-41a2-a156-98cc1f110a32 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:41.016803 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-133b8c5c-0c45-41a2-a156-98cc1f110a32 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1282 microversion: 2.20 time: 0.131651 Feb 21 02:31:41.021732 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 309/637] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:40 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:41.699033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4396db3c-eba0-499a-9c9f-bf478000cc33 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:41.700581 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4396db3c-eba0-499a-9c9f-bf478000cc33 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:41.714968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4396db3c-eba0-499a-9c9f-bf478000cc33 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:41.715618 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4396db3c-eba0-499a-9c9f-bf478000cc33 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:41.716895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4396db3c-eba0-499a-9c9f-bf478000cc33 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:41.719606 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4396db3c-eba0-499a-9c9f-bf478000cc33 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:41.941318 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4396db3c-eba0-499a-9c9f-bf478000cc33 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:41.951403 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4396db3c-eba0-499a-9c9f-bf478000cc33 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.262489 Feb 21 02:31:41.961562 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 329/638] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:41 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:42.035000 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:42.035941 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:42.044352 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:42.044946 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:42.045909 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:42.046455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:42.113667 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:42.121786 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:42.124015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:42.125987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0deaebd1-b119-4ad8-ba65-aa6f91f89938 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1286 microversion: 2.20 time: 0.094153 Feb 21 02:31:42.126732 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 310/639] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:42 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:42.969469 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f96e9774-3120-4589-a9d6-cf504f1305cd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:42.972447 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f96e9774-3120-4589-a9d6-cf504f1305cd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:42.979560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f96e9774-3120-4589-a9d6-cf504f1305cd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:42.980109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f96e9774-3120-4589-a9d6-cf504f1305cd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:42.980976 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f96e9774-3120-4589-a9d6-cf504f1305cd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:42.981490 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f96e9774-3120-4589-a9d6-cf504f1305cd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:43.127203 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f96e9774-3120-4589-a9d6-cf504f1305cd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:43.135002 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f96e9774-3120-4589-a9d6-cf504f1305cd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.170576 Feb 21 02:31:43.135570 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 330/640] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:42 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:43.144709 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:43.145366 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:43.151687 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:43.152132 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:43.152942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:43.153371 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:43.213505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:43.221629 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:43.223120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:43.224192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3b04078e-451c-4856-8b1a-7d76dc1104bb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1334 microversion: 2.20 time: 0.084052 Feb 21 02:31:43.224741 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 311/641] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:43 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1334 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:44.152314 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-cdb06180-09ad-4741-8b27-63d4aeaef0dd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:44.152851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-cdb06180-09ad-4741-8b27-63d4aeaef0dd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:44.159056 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cdb06180-09ad-4741-8b27-63d4aeaef0dd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:44.159480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cdb06180-09ad-4741-8b27-63d4aeaef0dd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:44.160564 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cdb06180-09ad-4741-8b27-63d4aeaef0dd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:44.160839 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cdb06180-09ad-4741-8b27-63d4aeaef0dd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:44.241685 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:44.243145 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:44.251102 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:44.252207 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:44.253845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:44.255069 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:44.321859 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cdb06180-09ad-4741-8b27-63d4aeaef0dd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:44.330423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-cdb06180-09ad-4741-8b27-63d4aeaef0dd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.181662 Feb 21 02:31:44.331476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 331/642] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:44 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:44.562446 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:44.570823 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:44.572312 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:44.573436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5855b51e-46a1-4a89-bc66-0e8e0d93d096 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.335433 Feb 21 02:31:44.574211 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 312/643] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:44 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:31:45.005067 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-3b302940-ec46-462b-96fb-16508a5db486 req-01358aed-49c0-4c90-bbdf-2c8e0e726d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b8e707-e1a8-46b8-8b47-ef1d9ef77903", "tag": "186e3f15-c158-44f9-a144-358d5ab62c8f"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:45.006695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:31:45.006695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:31:45.014717 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-3b302940-ec46-462b-96fb-16508a5db486 req-01358aed-49c0-4c90-bbdf-2c8e0e726d4d service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:45.015405 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-3b302940-ec46-462b-96fb-16508a5db486 req-01358aed-49c0-4c90-bbdf-2c8e0e726d4d service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:45.028670 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-3b302940-ec46-462b-96fb-16508a5db486 req-01358aed-49c0-4c90-bbdf-2c8e0e726d4d service nova] Creating event network-changed:186e3f15-c158-44f9-a144-358d5ab62c8f for instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 on hv-cinder-80447 Feb 21 02:31:45.034869 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-3b302940-ec46-462b-96fb-16508a5db486 req-01358aed-49c0-4c90-bbdf-2c8e0e726d4d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034207 Feb 21 02:31:45.035478 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 332/644] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:31:45.348397 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c1cb5531-a84e-4b0b-b36c-a0f8b326b23e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:45.349032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c1cb5531-a84e-4b0b-b36c-a0f8b326b23e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:45.355422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c1cb5531-a84e-4b0b-b36c-a0f8b326b23e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:45.355865 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c1cb5531-a84e-4b0b-b36c-a0f8b326b23e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:45.356753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c1cb5531-a84e-4b0b-b36c-a0f8b326b23e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:45.357054 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c1cb5531-a84e-4b0b-b36c-a0f8b326b23e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:45.489554 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c1cb5531-a84e-4b0b-b36c-a0f8b326b23e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:45.497307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c1cb5531-a84e-4b0b-b36c-a0f8b326b23e tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.153189 Feb 21 02:31:45.497840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 313/645] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:45 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:45.592326 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:45.593039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:45.599516 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:45.599958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:45.600722 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:45.601150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:45.735751 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:45.743340 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:45.744798 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:45.745902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9d0b8252-fde8-4846-a86c-d7b3deed7081 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.157538 Feb 21 02:31:45.746460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 333/646] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:45 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:46.514439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1f296615-8e6f-4d91-9dbe-9ec401a0a63d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:46.514967 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1f296615-8e6f-4d91-9dbe-9ec401a0a63d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:46.521739 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f296615-8e6f-4d91-9dbe-9ec401a0a63d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:46.522183 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f296615-8e6f-4d91-9dbe-9ec401a0a63d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:46.522948 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f296615-8e6f-4d91-9dbe-9ec401a0a63d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:46.523376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f296615-8e6f-4d91-9dbe-9ec401a0a63d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:46.653889 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1f296615-8e6f-4d91-9dbe-9ec401a0a63d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:46.661516 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1f296615-8e6f-4d91-9dbe-9ec401a0a63d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.150784 Feb 21 02:31:46.662103 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 314/647] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:46 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:46.764123 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:46.764774 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:46.771890 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:46.772335 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:46.773103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:46.773540 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:46.907895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:46.915465 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:46.916950 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:46.918067 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0f8d8317-b5ad-4c42-8bf6-7501f1468056 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.157616 Feb 21 02:31:46.918623 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 334/648] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:46 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:47.678591 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4cdbdb08-5cec-4505-8bd2-efea2a30adfb tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:47.679231 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4cdbdb08-5cec-4505-8bd2-efea2a30adfb tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:47.685507 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cdbdb08-5cec-4505-8bd2-efea2a30adfb tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:47.685981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cdbdb08-5cec-4505-8bd2-efea2a30adfb tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:47.686744 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cdbdb08-5cec-4505-8bd2-efea2a30adfb tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:47.687172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cdbdb08-5cec-4505-8bd2-efea2a30adfb tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:47.824837 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4cdbdb08-5cec-4505-8bd2-efea2a30adfb tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:47.833505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4cdbdb08-5cec-4505-8bd2-efea2a30adfb tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1723 microversion: 2.1 time: 0.158478 Feb 21 02:31:47.834118 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 315/649] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:47 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:47.935059 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:47.935558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:47.941479 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:47.941967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:47.942730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:47.943164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:48.076370 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:48.084628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:48.086130 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:48.087220 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-09014c20-244a-44f8-a1b7-0d89c37e1efa tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.155957 Feb 21 02:31:48.087775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 335/650] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:47 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:48.850883 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-72debde2-020e-4880-8fa2-8774b1f94c24 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:48.851499 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-72debde2-020e-4880-8fa2-8774b1f94c24 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:48.858630 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-72debde2-020e-4880-8fa2-8774b1f94c24 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:48.859081 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-72debde2-020e-4880-8fa2-8774b1f94c24 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:48.860125 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-72debde2-020e-4880-8fa2-8774b1f94c24 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:48.861118 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-72debde2-020e-4880-8fa2-8774b1f94c24 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:49.000329 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-72debde2-020e-4880-8fa2-8774b1f94c24 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:49.008469 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-72debde2-020e-4880-8fa2-8774b1f94c24 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1700 microversion: 2.1 time: 0.161141 Feb 21 02:31:49.009043 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 316/651] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:48 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:49.024296 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6cf93c45-6a52-434c-9bd9-ffbb36b7c7ab tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:49.031795 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6cf93c45-6a52-434c-9bd9-ffbb36b7c7ab tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:49.032836 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6cf93c45-6a52-434c-9bd9-ffbb36b7c7ab tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:49.094468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6cf93c45-6a52-434c-9bd9-ffbb36b7c7ab tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Going to try to start instance {{(pid=116711) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 02:31:49.106539 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:49.107326 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:49.114790 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:49.115657 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:49.116454 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:49.117061 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:49.148334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6cf93c45-6a52-434c-9bd9-ffbb36b7c7ab tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/action" status: 202 len: 0 microversion: 2.1 time: 0.127453 Feb 21 02:31:49.148936 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 336/652] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:31:49 2022] POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:31:49.159592 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f9808bf3-aaea-4b03-9de4-8dbb49725831 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:49.160499 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f9808bf3-aaea-4b03-9de4-8dbb49725831 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:49.167599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f9808bf3-aaea-4b03-9de4-8dbb49725831 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:49.168252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f9808bf3-aaea-4b03-9de4-8dbb49725831 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:49.169302 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f9808bf3-aaea-4b03-9de4-8dbb49725831 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:49.169797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f9808bf3-aaea-4b03-9de4-8dbb49725831 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:49.259112 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:49.268504 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:49.270239 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:49.271387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6cc99b9a-8a54-4b8d-8a92-39f3555a2b95 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.170002 Feb 21 02:31:49.271950 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 317/653] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:49 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:31:49.305293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f9808bf3-aaea-4b03-9de4-8dbb49725831 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:49.313003 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f9808bf3-aaea-4b03-9de4-8dbb49725831 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1709 microversion: 2.1 time: 0.158094 Feb 21 02:31:49.313604 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 337/654] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:49 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:50.289220 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:50.289784 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:50.295970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:50.296419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:50.297185 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:50.297618 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:50.331462 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c7315092-faf1-4b8a-9ae8-372a42be88e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:50.331462 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c7315092-faf1-4b8a-9ae8-372a42be88e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:50.337998 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c7315092-faf1-4b8a-9ae8-372a42be88e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:50.338612 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c7315092-faf1-4b8a-9ae8-372a42be88e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:50.339354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c7315092-faf1-4b8a-9ae8-372a42be88e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:50.339930 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c7315092-faf1-4b8a-9ae8-372a42be88e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:50.435174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:50.443024 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:50.444574 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:50.445764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c92f5269-a566-469f-a3a7-731da14d8993 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.160323 Feb 21 02:31:50.446399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 318/655] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:50 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:50.472780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c7315092-faf1-4b8a-9ae8-372a42be88e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:50.480311 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c7315092-faf1-4b8a-9ae8-372a42be88e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1709 microversion: 2.1 time: 0.153368 Feb 21 02:31:50.480864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 338/656] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:50 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:51.463773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:51.464336 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:51.470708 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:51.471183 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:51.471950 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:51.472380 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:51.497629 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0f9f4102-e1bd-494d-b834-6d84bda98884 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:51.498258 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0f9f4102-e1bd-494d-b834-6d84bda98884 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:51.505169 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f9f4102-e1bd-494d-b834-6d84bda98884 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:51.505612 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f9f4102-e1bd-494d-b834-6d84bda98884 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:51.506417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f9f4102-e1bd-494d-b834-6d84bda98884 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:51.506851 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0f9f4102-e1bd-494d-b834-6d84bda98884 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:51.607174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:51.616019 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:51.617490 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:51.618636 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1f71b986-64eb-4cfa-899d-0fce925625ff tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.158598 Feb 21 02:31:51.619190 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 319/657] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:51 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:51.642882 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0f9f4102-e1bd-494d-b834-6d84bda98884 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:51.650422 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0f9f4102-e1bd-494d-b834-6d84bda98884 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1709 microversion: 2.1 time: 0.156371 Feb 21 02:31:51.650981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 339/658] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:51 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:52.637299 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:52.637930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:52.644482 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:52.644929 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:52.645731 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:52.646168 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:52.667042 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-38f54996-acd2-4abe-9b84-cc6764329bbf tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:52.667657 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-38f54996-acd2-4abe-9b84-cc6764329bbf tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:52.674612 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38f54996-acd2-4abe-9b84-cc6764329bbf tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:52.675066 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38f54996-acd2-4abe-9b84-cc6764329bbf tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:52.675852 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38f54996-acd2-4abe-9b84-cc6764329bbf tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:52.676291 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38f54996-acd2-4abe-9b84-cc6764329bbf tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:52.788080 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:52.795928 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:52.797406 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:52.799113 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6707ea45-5ffe-42b4-80f8-b32d2cca029f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.165631 Feb 21 02:31:52.799669 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 320/659] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:52 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:52.813205 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-38f54996-acd2-4abe-9b84-cc6764329bbf tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:52.820970 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-38f54996-acd2-4abe-9b84-cc6764329bbf tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1709 microversion: 2.1 time: 0.157568 Feb 21 02:31:52.821530 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 340/660] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:52 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:53.512968 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-123171195", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "networks": [{"uuid": "26881fc9-45ba-431f-a03d-7739d0624db9"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:53.560804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] validate_networks() for [('26881fc9-45ba-431f-a03d-7739d0624db9', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:31:53.817167 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:53.817777 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:53.824168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:53.824612 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:53.825377 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:53.825832 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:53.896476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:31:53.896995 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:31:53.897367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:31:53.897798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:31:53.898202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:31:53.907295 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:53.907800 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:53.908602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:53.909033 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:53.925514 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Getting quotas for project 85d4895c6155469e9922d6ad6e152051. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:31:53.929348 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Getting quotas for user 8518b2eaf3144249af9733b819aa27d6 and project 85d4895c6155469e9922d6ad6e152051. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:31:53.943464 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:31:53.945790 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:31:53.967696 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:53.977731 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:53.979210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:53.980290 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ba65481b-0c13-425f-93b6-08b6549de385 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.167803 Feb 21 02:31:53.987916 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 341/661] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:53 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:31:53.992345 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-abf268cf-a444-4e64-b113-0d78b66e0f1c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:53.992948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-abf268cf-a444-4e64-b113-0d78b66e0f1c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:53.993804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1283107b-0b18-443c-a134-dd67aacbd2ea tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484367 Feb 21 02:31:53.994552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 321/662] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:31:53.999062 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-abf268cf-a444-4e64-b113-0d78b66e0f1c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:53.999514 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-abf268cf-a444-4e64-b113-0d78b66e0f1c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:54.000292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-abf268cf-a444-4e64-b113-0d78b66e0f1c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:54.000734 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-abf268cf-a444-4e64-b113-0d78b66e0f1c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:54.004694 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-37cdfc89-b264-4573-8fff-58f2508745bb tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:54.006377 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-37cdfc89-b264-4573-8fff-58f2508745bb tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:54.059796 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-37cdfc89-b264-4573-8fff-58f2508745bb tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:54.067563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-37cdfc89-b264-4573-8fff-58f2508745bb tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1218 microversion: 2.1 time: 0.067155 Feb 21 02:31:54.068489 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 322/663] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:53 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:54.139810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-abf268cf-a444-4e64-b113-0d78b66e0f1c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:54.147973 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-abf268cf-a444-4e64-b113-0d78b66e0f1c tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1709 microversion: 2.1 time: 0.159023 Feb 21 02:31:54.148540 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 342/664] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:53 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:54.998627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:54.999239 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:55.006417 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:55.006869 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:55.007645 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:55.008081 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:55.084809 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fd27bec7-be68-4834-9bda-a2eee93e14ef tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:55.085415 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fd27bec7-be68-4834-9bda-a2eee93e14ef tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:55.091589 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd27bec7-be68-4834-9bda-a2eee93e14ef tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:55.092038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd27bec7-be68-4834-9bda-a2eee93e14ef tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:55.092814 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd27bec7-be68-4834-9bda-a2eee93e14ef tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:55.093247 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd27bec7-be68-4834-9bda-a2eee93e14ef tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:55.139466 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:55.148061 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:55.149551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:55.150913 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4cdb2753-796a-4ebd-8fef-42a706d90beb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.155730 Feb 21 02:31:55.151227 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 323/665] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:54 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:55.153131 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fd27bec7-be68-4834-9bda-a2eee93e14ef tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:55.160656 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fd27bec7-be68-4834-9bda-a2eee93e14ef tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1222 microversion: 2.1 time: 0.079490 Feb 21 02:31:55.161303 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 343/666] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:55 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:55.164999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ae39452a-49e0-4908-877a-e4e1067414e7 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:55.165600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ae39452a-49e0-4908-877a-e4e1067414e7 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:55.171280 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ae39452a-49e0-4908-877a-e4e1067414e7 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:55.171723 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ae39452a-49e0-4908-877a-e4e1067414e7 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:55.172482 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ae39452a-49e0-4908-877a-e4e1067414e7 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:55.173453 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ae39452a-49e0-4908-877a-e4e1067414e7 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:55.307401 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ae39452a-49e0-4908-877a-e4e1067414e7 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:55.316048 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ae39452a-49e0-4908-877a-e4e1067414e7 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1709 microversion: 2.1 time: 0.154730 Feb 21 02:31:55.316608 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 324/667] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:55 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:56.168494 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:56.169099 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:56.176035 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:56.176485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:56.177285 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:56.177398 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5ed6b96a-659e-4072-80c4-ac0ca0e1bd84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:56.177825 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:56.178049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5ed6b96a-659e-4072-80c4-ac0ca0e1bd84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:56.184240 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5ed6b96a-659e-4072-80c4-ac0ca0e1bd84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:56.184689 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5ed6b96a-659e-4072-80c4-ac0ca0e1bd84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:56.185470 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5ed6b96a-659e-4072-80c4-ac0ca0e1bd84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:56.185939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5ed6b96a-659e-4072-80c4-ac0ca0e1bd84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:56.245509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5ed6b96a-659e-4072-80c4-ac0ca0e1bd84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:56.252989 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5ed6b96a-659e-4072-80c4-ac0ca0e1bd84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1222 microversion: 2.1 time: 0.079379 Feb 21 02:31:56.253560 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 325/668] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:56 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:56.315252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:56.322901 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:56.324378 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:56.325471 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0db76750-514d-4f25-86a7-d43c6705fdda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.160655 Feb 21 02:31:56.326334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 344/669] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:56 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:56.332402 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-82800e55-8fef-464c-83ad-2bb568437fb5 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:56.333004 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-82800e55-8fef-464c-83ad-2bb568437fb5 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:56.339269 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-82800e55-8fef-464c-83ad-2bb568437fb5 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:56.339722 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-82800e55-8fef-464c-83ad-2bb568437fb5 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:56.340504 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-82800e55-8fef-464c-83ad-2bb568437fb5 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:56.340944 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-82800e55-8fef-464c-83ad-2bb568437fb5 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:56.471379 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-82800e55-8fef-464c-83ad-2bb568437fb5 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:56.479118 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-82800e55-8fef-464c-83ad-2bb568437fb5 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1709 microversion: 2.1 time: 0.150902 Feb 21 02:31:56.479691 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 326/670] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:56 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:57.269571 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2693bd5c-151f-4172-8bb9-0ecd8b9e0a1e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:57.270156 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2693bd5c-151f-4172-8bb9-0ecd8b9e0a1e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:57.276464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2693bd5c-151f-4172-8bb9-0ecd8b9e0a1e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:57.276876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2693bd5c-151f-4172-8bb9-0ecd8b9e0a1e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:57.277763 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2693bd5c-151f-4172-8bb9-0ecd8b9e0a1e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:57.278195 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2693bd5c-151f-4172-8bb9-0ecd8b9e0a1e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:57.338077 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2693bd5c-151f-4172-8bb9-0ecd8b9e0a1e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:57.343911 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:57.345015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:57.346054 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2693bd5c-151f-4172-8bb9-0ecd8b9e0a1e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1270 microversion: 2.1 time: 0.080185 Feb 21 02:31:57.346795 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 345/671] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:57 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:57.351393 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:57.351840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:57.352649 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:57.353083 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:57.490935 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:57.495939 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3bc767cc-1f2f-48db-a312-1e7317fbabcd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:57.496553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3bc767cc-1f2f-48db-a312-1e7317fbabcd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:57.498846 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:57.500334 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:57.501930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-77292c7f-51c0-4fd2-8287-ff6fdb07069d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.161340 Feb 21 02:31:57.502497 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 327/672] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:57 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:31:57.502605 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3bc767cc-1f2f-48db-a312-1e7317fbabcd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:57.502967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3bc767cc-1f2f-48db-a312-1e7317fbabcd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:57.503754 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3bc767cc-1f2f-48db-a312-1e7317fbabcd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:57.504194 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3bc767cc-1f2f-48db-a312-1e7317fbabcd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:57.634999 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3bc767cc-1f2f-48db-a312-1e7317fbabcd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:57.643340 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3bc767cc-1f2f-48db-a312-1e7317fbabcd tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1713 microversion: 2.1 time: 0.150972 Feb 21 02:31:57.643953 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 346/673] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:57 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:31:58.364950 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b1217339-d755-433e-8723-2dc614d98a8a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:58.366293 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b1217339-d755-433e-8723-2dc614d98a8a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:58.372872 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1217339-d755-433e-8723-2dc614d98a8a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:58.373360 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1217339-d755-433e-8723-2dc614d98a8a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:58.374256 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1217339-d755-433e-8723-2dc614d98a8a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:58.374746 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1217339-d755-433e-8723-2dc614d98a8a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:58.448571 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b1217339-d755-433e-8723-2dc614d98a8a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:58.456371 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b1217339-d755-433e-8723-2dc614d98a8a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1276 microversion: 2.1 time: 0.096741 Feb 21 02:31:58.457089 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 328/674] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:58 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:58.519677 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:58.520366 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:58.526301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:58.526771 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:58.527518 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:58.528022 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:58.664559 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:58.673626 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:58.675355 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:58.676722 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f2e35f8f-0ea0-4f2d-9044-44170133ee73 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.160807 Feb 21 02:31:58.677339 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 347/675] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:58 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:31:59.419070 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-6d12d530-5242-482c-80af-717ecfc77d96 req-023d14fd-abee-4ffe-a878-12dbb55af4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d57bba-d8da-48e6-a336-4a45b02a871d", "tag": "962ea4ca-f539-43b8-b4bb-f284776dc2a8"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:31:59.421062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:31:59.421062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:31:59.430157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-6d12d530-5242-482c-80af-717ecfc77d96 req-023d14fd-abee-4ffe-a878-12dbb55af4ef service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:59.430606 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-6d12d530-5242-482c-80af-717ecfc77d96 req-023d14fd-abee-4ffe-a878-12dbb55af4ef service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:59.442309 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-6d12d530-5242-482c-80af-717ecfc77d96 req-023d14fd-abee-4ffe-a878-12dbb55af4ef service nova] Creating event network-changed:962ea4ca-f539-43b8-b4bb-f284776dc2a8 for instance a6d57bba-d8da-48e6-a336-4a45b02a871d on hv-cinder-80447 Feb 21 02:31:59.447067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-6d12d530-5242-482c-80af-717ecfc77d96 req-023d14fd-abee-4ffe-a878-12dbb55af4ef service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Feb 21 02:31:59.447657 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 329/676] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:31:59.473513 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f3048471-5c1b-49a6-9af1-e8c317f61242 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:59.474236 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f3048471-5c1b-49a6-9af1-e8c317f61242 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:59.480265 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f3048471-5c1b-49a6-9af1-e8c317f61242 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:59.480710 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f3048471-5c1b-49a6-9af1-e8c317f61242 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:59.481480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f3048471-5c1b-49a6-9af1-e8c317f61242 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:59.481963 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f3048471-5c1b-49a6-9af1-e8c317f61242 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:59.620949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f3048471-5c1b-49a6-9af1-e8c317f61242 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:31:59.628565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f3048471-5c1b-49a6-9af1-e8c317f61242 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.158799 Feb 21 02:31:59.637566 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 348/677] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:31:59 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:31:59.696918 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:31:59.697844 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:31:59.705051 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:59.705696 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:31:59.706743 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:31:59.707344 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:00.160376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:00.167969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:00.169452 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:00.170647 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d862ff4b-469c-43f9-b941-9dbbd44ca5c9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.479067 Feb 21 02:32:00.171361 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 330/678] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:31:59 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:00.644785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3b0073ca-8f0c-47f3-9940-cab0b24458ed tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:00.645385 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3b0073ca-8f0c-47f3-9940-cab0b24458ed tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:00.651813 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3b0073ca-8f0c-47f3-9940-cab0b24458ed tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:00.652264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3b0073ca-8f0c-47f3-9940-cab0b24458ed tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:00.653035 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3b0073ca-8f0c-47f3-9940-cab0b24458ed tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:00.653467 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3b0073ca-8f0c-47f3-9940-cab0b24458ed tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:00.787532 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3b0073ca-8f0c-47f3-9940-cab0b24458ed tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:00.795045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3b0073ca-8f0c-47f3-9940-cab0b24458ed tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.154363 Feb 21 02:32:00.796022 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 349/679] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:00 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:01.190032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:01.190631 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:01.197061 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:01.197500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:01.198295 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:01.198726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:01.332268 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:01.339949 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:01.341442 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:01.342563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2beae126-25b5-4608-9f5a-4071c5bc3420 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.156985 Feb 21 02:32:01.343125 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 331/680] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:01 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:01.812485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-db7f1cb1-56a1-4626-9c8d-4f06b02c241a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:01.813828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-db7f1cb1-56a1-4626-9c8d-4f06b02c241a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:01.820878 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db7f1cb1-56a1-4626-9c8d-4f06b02c241a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:01.821516 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db7f1cb1-56a1-4626-9c8d-4f06b02c241a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:01.822346 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db7f1cb1-56a1-4626-9c8d-4f06b02c241a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:01.822771 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-db7f1cb1-56a1-4626-9c8d-4f06b02c241a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:01.965939 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-db7f1cb1-56a1-4626-9c8d-4f06b02c241a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:01.974269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-db7f1cb1-56a1-4626-9c8d-4f06b02c241a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.165795 Feb 21 02:32:01.974786 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 350/681] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:01 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:02.360503 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:02.361138 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:02.367385 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:02.367830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:02.368607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:02.369037 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:02.498827 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:02.507235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:02.508701 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:02.509809 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-257bfc2c-d155-4e82-a2b3-4da9addd5f56 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.153428 Feb 21 02:32:02.510364 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 332/682] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:02 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:02.997712 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-264161da-a522-48d4-802c-f60afa78fea3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:02.998317 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-264161da-a522-48d4-802c-f60afa78fea3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:03.005381 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-264161da-a522-48d4-802c-f60afa78fea3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:03.005867 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-264161da-a522-48d4-802c-f60afa78fea3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:03.006717 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-264161da-a522-48d4-802c-f60afa78fea3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:03.007201 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-264161da-a522-48d4-802c-f60afa78fea3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:03.139973 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-264161da-a522-48d4-802c-f60afa78fea3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:03.147386 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-264161da-a522-48d4-802c-f60afa78fea3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.153356 Feb 21 02:32:03.147958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 351/683] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:02 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:03.527829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:03.528346 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:03.535259 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:03.535710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:03.536485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:03.536919 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:03.666982 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:03.674864 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:03.676354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:03.677449 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f74e35c9-a225-4f7f-8d70-f46dbdf8c98e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.153451 Feb 21 02:32:03.678040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 333/684] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:03 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:04.164114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e3800586-4b3e-45c5-b86c-b7eb4d8be5bc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:04.164754 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e3800586-4b3e-45c5-b86c-b7eb4d8be5bc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:04.170931 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3800586-4b3e-45c5-b86c-b7eb4d8be5bc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:04.171378 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3800586-4b3e-45c5-b86c-b7eb4d8be5bc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:04.172150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3800586-4b3e-45c5-b86c-b7eb4d8be5bc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:04.173404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e3800586-4b3e-45c5-b86c-b7eb4d8be5bc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:04.303422 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e3800586-4b3e-45c5-b86c-b7eb4d8be5bc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:04.310569 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e3800586-4b3e-45c5-b86c-b7eb4d8be5bc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.150168 Feb 21 02:32:04.311127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 352/685] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:04 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:04.695176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:04.695783 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:04.702053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:04.702502 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:04.703286 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:04.704466 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:04.838645 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:04.846256 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:04.847752 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:04.848845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bc98b173-9bec-4d7a-8596-d238c727c1d7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.157351 Feb 21 02:32:04.849403 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 334/686] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:04 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:05.327582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a263b505-1772-44df-898d-c533a1b64eb7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:05.328136 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a263b505-1772-44df-898d-c533a1b64eb7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:05.334824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a263b505-1772-44df-898d-c533a1b64eb7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:05.335277 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a263b505-1772-44df-898d-c533a1b64eb7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:05.336067 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a263b505-1772-44df-898d-c533a1b64eb7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:05.336502 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a263b505-1772-44df-898d-c533a1b64eb7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:05.470168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a263b505-1772-44df-898d-c533a1b64eb7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:05.478020 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a263b505-1772-44df-898d-c533a1b64eb7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.153766 Feb 21 02:32:05.478460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 353/687] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:05 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:05.866463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:05.867106 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:05.873347 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:05.873834 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:05.874613 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:05.875053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:06.009682 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:06.017710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:06.019186 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:06.020267 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-efef09c1-f2ba-496f-9125-3b7295681bc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.157544 Feb 21 02:32:06.020820 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 335/688] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:05 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:06.496148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7f25a9df-189b-4d98-9640-4ad075db05d7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:06.496752 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7f25a9df-189b-4d98-9640-4ad075db05d7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:06.504048 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7f25a9df-189b-4d98-9640-4ad075db05d7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:06.504504 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7f25a9df-189b-4d98-9640-4ad075db05d7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:06.505291 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7f25a9df-189b-4d98-9640-4ad075db05d7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:06.505766 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7f25a9df-189b-4d98-9640-4ad075db05d7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:06.638929 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7f25a9df-189b-4d98-9640-4ad075db05d7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:06.646428 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7f25a9df-189b-4d98-9640-4ad075db05d7 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.154234 Feb 21 02:32:06.646985 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 354/689] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:06 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:07.038326 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:07.038933 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:07.045121 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:07.045571 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:07.046381 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:07.046817 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:07.176735 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:07.184372 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:07.185886 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:07.186967 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-064317a1-116b-4f39-a75b-4e2f36c01cd0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.152351 Feb 21 02:32:07.187521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 336/690] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:07 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:07.663003 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a937a17d-2943-4bc5-8bf4-c72659f35d31 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:07.663669 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a937a17d-2943-4bc5-8bf4-c72659f35d31 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:07.669852 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a937a17d-2943-4bc5-8bf4-c72659f35d31 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:07.670301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a937a17d-2943-4bc5-8bf4-c72659f35d31 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:07.671069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a937a17d-2943-4bc5-8bf4-c72659f35d31 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:07.671502 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a937a17d-2943-4bc5-8bf4-c72659f35d31 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:07.799600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a937a17d-2943-4bc5-8bf4-c72659f35d31 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:07.806828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a937a17d-2943-4bc5-8bf4-c72659f35d31 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.147479 Feb 21 02:32:07.807386 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 355/691] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:07 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:08.204451 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:08.205091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:08.211324 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:08.211766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:08.212539 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:08.212974 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:08.351488 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:08.359272 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:08.361657 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:08.362781 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8e7cceb0-57fd-4c5b-a953-c1f50d73c734 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.162133 Feb 21 02:32:08.363333 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 337/692] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:08 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:08.824815 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ddcd1cc7-94c2-43ef-ae88-715d6041f349 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:08.825420 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ddcd1cc7-94c2-43ef-ae88-715d6041f349 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:08.832549 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ddcd1cc7-94c2-43ef-ae88-715d6041f349 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:08.832993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ddcd1cc7-94c2-43ef-ae88-715d6041f349 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:08.833793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ddcd1cc7-94c2-43ef-ae88-715d6041f349 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:08.834231 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ddcd1cc7-94c2-43ef-ae88-715d6041f349 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:08.970908 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ddcd1cc7-94c2-43ef-ae88-715d6041f349 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:08.978785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ddcd1cc7-94c2-43ef-ae88-715d6041f349 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.157339 Feb 21 02:32:08.979395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 356/693] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:08 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:09.381073 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:09.381710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:09.387951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:09.388394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:09.389163 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:09.389594 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:09.522641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:09.530233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:09.531710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:09.532830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-db078501-035e-48a1-90b3-74b01b58c395 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.155457 Feb 21 02:32:09.533389 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 338/694] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:09 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:09.995961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e67b6b24-6afd-4f15-bac8-3c37bbc13f8b tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:09.996565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e67b6b24-6afd-4f15-bac8-3c37bbc13f8b tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:10.003004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e67b6b24-6afd-4f15-bac8-3c37bbc13f8b tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:10.003449 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e67b6b24-6afd-4f15-bac8-3c37bbc13f8b tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:10.004212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e67b6b24-6afd-4f15-bac8-3c37bbc13f8b tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:10.004640 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e67b6b24-6afd-4f15-bac8-3c37bbc13f8b tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:10.134820 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e67b6b24-6afd-4f15-bac8-3c37bbc13f8b tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:10.142229 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e67b6b24-6afd-4f15-bac8-3c37bbc13f8b tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.149593 Feb 21 02:32:10.142802 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 357/695] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:09 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:10.302867 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-e6a5d17a-3fd7-4fb4-a0de-b05b6ae012d0 req-c1df3928-cf9e-40fb-a05f-e28535e67c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8e707-e1a8-46b8-8b47-ef1d9ef77903", "name": "network-vif-plugged", "status": "completed", "tag": "186e3f15-c158-44f9-a144-358d5ab62c8f"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:32:10.304416 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:32:10.304416 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:32:10.311938 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-e6a5d17a-3fd7-4fb4-a0de-b05b6ae012d0 req-c1df3928-cf9e-40fb-a05f-e28535e67c0e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:10.312532 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-e6a5d17a-3fd7-4fb4-a0de-b05b6ae012d0 req-c1df3928-cf9e-40fb-a05f-e28535e67c0e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:10.323531 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-e6a5d17a-3fd7-4fb4-a0de-b05b6ae012d0 req-c1df3928-cf9e-40fb-a05f-e28535e67c0e service nova] Creating event network-vif-plugged:186e3f15-c158-44f9-a144-358d5ab62c8f for instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 on hv-cinder-80447 Feb 21 02:32:10.328322 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-e6a5d17a-3fd7-4fb4-a0de-b05b6ae012d0 req-c1df3928-cf9e-40fb-a05f-e28535e67c0e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028989 Feb 21 02:32:10.329732 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 339/696] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:32:10.550791 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:10.551431 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:10.557371 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:10.557864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:10.558648 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:10.559087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:10.696095 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:10.704402 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:10.705906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:10.706992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fd1a70d2-8568-4116-abd7-b40809532e0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.160303 Feb 21 02:32:10.707542 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 358/697] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:10 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:11.160007 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d47726bd-c11c-47df-938c-fbb97e0b51fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:11.160620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d47726bd-c11c-47df-938c-fbb97e0b51fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:11.166747 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d47726bd-c11c-47df-938c-fbb97e0b51fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:11.167186 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d47726bd-c11c-47df-938c-fbb97e0b51fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:11.167963 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d47726bd-c11c-47df-938c-fbb97e0b51fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:11.168392 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d47726bd-c11c-47df-938c-fbb97e0b51fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:11.303651 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d47726bd-c11c-47df-938c-fbb97e0b51fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:11.310866 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d47726bd-c11c-47df-938c-fbb97e0b51fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.155391 Feb 21 02:32:11.311449 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 340/698] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:11 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:11.724732 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:11.725286 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:11.731423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:11.731868 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:11.732638 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:11.733071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:11.867477 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:11.875007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:11.877172 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:11.878284 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5948e7eb-b88b-46b3-9cbc-d933f35af86e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.157339 Feb 21 02:32:11.878829 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 359/699] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:11 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:12.328052 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8ae080de-2437-4135-bb52-43269a95bed5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:12.328894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8ae080de-2437-4135-bb52-43269a95bed5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:12.335157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8ae080de-2437-4135-bb52-43269a95bed5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:12.335598 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8ae080de-2437-4135-bb52-43269a95bed5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:12.336373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8ae080de-2437-4135-bb52-43269a95bed5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:12.336808 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8ae080de-2437-4135-bb52-43269a95bed5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:12.467818 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8ae080de-2437-4135-bb52-43269a95bed5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:12.475594 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8ae080de-2437-4135-bb52-43269a95bed5 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.151192 Feb 21 02:32:12.476160 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 341/700] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:12 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:12.895570 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:12.896210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:12.902778 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:12.903226 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:12.904007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:12.904445 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:13.036672 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:13.044601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:13.046690 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:13.048870 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-51e28c34-4d31-434e-b185-edb5a0434d69 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1408 microversion: 2.20 time: 0.156914 Feb 21 02:32:13.049440 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 360/701] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:12 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:13.492110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a478c144-c8aa-4852-92fe-4ecb29c2199f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:13.492717 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a478c144-c8aa-4852-92fe-4ecb29c2199f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:13.498964 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a478c144-c8aa-4852-92fe-4ecb29c2199f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:13.499405 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a478c144-c8aa-4852-92fe-4ecb29c2199f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:13.500414 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a478c144-c8aa-4852-92fe-4ecb29c2199f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:13.500821 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a478c144-c8aa-4852-92fe-4ecb29c2199f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:13.637805 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a478c144-c8aa-4852-92fe-4ecb29c2199f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:13.645666 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a478c144-c8aa-4852-92fe-4ecb29c2199f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.157251 Feb 21 02:32:13.646245 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 342/702] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:13 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:14.067607 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:14.068159 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:14.074503 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:14.074981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:14.074981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:14.076135 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:14.226710 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:14.235802 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:14.237325 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:14.238588 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7037922d-f1b1-4d58-9c4b-123f1cf4027c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1600 microversion: 2.20 time: 0.175591 Feb 21 02:32:14.239187 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 361/703] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:32:14 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:32:14.257208 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6a94e8b2-11a3-45e7-a06b-eb6edeef7ee0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:14.257750 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6a94e8b2-11a3-45e7-a06b-eb6edeef7ee0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:14.264769 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6a94e8b2-11a3-45e7-a06b-eb6edeef7ee0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:14.265213 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6a94e8b2-11a3-45e7-a06b-eb6edeef7ee0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:14.266074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6a94e8b2-11a3-45e7-a06b-eb6edeef7ee0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:14.266505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6a94e8b2-11a3-45e7-a06b-eb6edeef7ee0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:14.355096 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6a94e8b2-11a3-45e7-a06b-eb6edeef7ee0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101402 Feb 21 02:32:14.355732 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 343/704] 10.222.0.75 () {60 vars in 1315 bytes} [Mon Feb 21 02:32:14 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:32:14.662729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-438fb2bf-b6b4-4b17-a2d5-9f1321ee04e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:14.663336 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-438fb2bf-b6b4-4b17-a2d5-9f1321ee04e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:14.669046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-438fb2bf-b6b4-4b17-a2d5-9f1321ee04e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:14.669489 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-438fb2bf-b6b4-4b17-a2d5-9f1321ee04e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:14.670311 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-438fb2bf-b6b4-4b17-a2d5-9f1321ee04e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:14.670741 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-438fb2bf-b6b4-4b17-a2d5-9f1321ee04e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:14.805036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-438fb2bf-b6b4-4b17-a2d5-9f1321ee04e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:14.813217 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-438fb2bf-b6b4-4b17-a2d5-9f1321ee04e3 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.154030 Feb 21 02:32:14.814099 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 362/705] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:14 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:15.180251 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-25fa5692-dae1-468b-a84a-5b6a7e812003 req-55158975-0da9-4abc-bccb-29f52fdb1f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d57bba-d8da-48e6-a336-4a45b02a871d", "name": "network-vif-plugged", "status": "completed", "tag": "962ea4ca-f539-43b8-b4bb-f284776dc2a8"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:32:15.182011 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:32:15.182011 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:32:15.190554 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-25fa5692-dae1-468b-a84a-5b6a7e812003 req-55158975-0da9-4abc-bccb-29f52fdb1f3b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:15.191105 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-25fa5692-dae1-468b-a84a-5b6a7e812003 req-55158975-0da9-4abc-bccb-29f52fdb1f3b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:15.202357 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-25fa5692-dae1-468b-a84a-5b6a7e812003 req-55158975-0da9-4abc-bccb-29f52fdb1f3b service nova] Creating event network-vif-plugged:962ea4ca-f539-43b8-b4bb-f284776dc2a8 for instance a6d57bba-d8da-48e6-a336-4a45b02a871d on hv-cinder-80447 Feb 21 02:32:15.208122 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-25fa5692-dae1-468b-a84a-5b6a7e812003 req-55158975-0da9-4abc-bccb-29f52fdb1f3b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031336 Feb 21 02:32:15.208821 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 344/706] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:32:15.339093 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-60a410af-eaa9-4b58-a349-cd9068eeb2c6 req-b73c03f7-18be-4d1b-8ecd-0566e028c70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b8e707-e1a8-46b8-8b47-ef1d9ef77903", "tag": "186e3f15-c158-44f9-a144-358d5ab62c8f"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:32:15.340573 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:32:15.340573 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:32:15.343509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-197116b3-e4a4-4874-9ca9-b8a0b5481bdd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:15.344063 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-197116b3-e4a4-4874-9ca9-b8a0b5481bdd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:15.348018 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-60a410af-eaa9-4b58-a349-cd9068eeb2c6 req-b73c03f7-18be-4d1b-8ecd-0566e028c70e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:15.348454 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-60a410af-eaa9-4b58-a349-cd9068eeb2c6 req-b73c03f7-18be-4d1b-8ecd-0566e028c70e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:15.350768 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-197116b3-e4a4-4874-9ca9-b8a0b5481bdd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:15.351225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-197116b3-e4a4-4874-9ca9-b8a0b5481bdd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:15.352016 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-197116b3-e4a4-4874-9ca9-b8a0b5481bdd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:15.352695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-197116b3-e4a4-4874-9ca9-b8a0b5481bdd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:15.359251 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-60a410af-eaa9-4b58-a349-cd9068eeb2c6 req-b73c03f7-18be-4d1b-8ecd-0566e028c70e service nova] Creating event network-changed:186e3f15-c158-44f9-a144-358d5ab62c8f for instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 on hv-cinder-80447 Feb 21 02:32:15.369670 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-60a410af-eaa9-4b58-a349-cd9068eeb2c6 req-b73c03f7-18be-4d1b-8ecd-0566e028c70e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032408 Feb 21 02:32:15.370283 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 345/707] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:32:15.377045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-197116b3-e4a4-4874-9ca9-b8a0b5481bdd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/ips" status: 200 len: 112 microversion: 2.20 time: 0.045969 Feb 21 02:32:15.377617 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 363/708] 10.222.0.75 () {60 vars in 1288 bytes} [Mon Feb 21 02:32:15 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/ips => generated 112 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:32:15.830652 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6d0afa38-d557-40e1-a13b-f5d37d19a561 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:15.831341 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6d0afa38-d557-40e1-a13b-f5d37d19a561 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:15.838277 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6d0afa38-d557-40e1-a13b-f5d37d19a561 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:15.839147 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6d0afa38-d557-40e1-a13b-f5d37d19a561 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:15.840492 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6d0afa38-d557-40e1-a13b-f5d37d19a561 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:15.841120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6d0afa38-d557-40e1-a13b-f5d37d19a561 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:15.987581 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6d0afa38-d557-40e1-a13b-f5d37d19a561 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:15.994882 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6d0afa38-d557-40e1-a13b-f5d37d19a561 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.168146 Feb 21 02:32:15.995456 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 346/709] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:15 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:17.012029 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-acaa5e42-b777-431d-b15b-e47cfbbacf99 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:17.012639 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-acaa5e42-b777-431d-b15b-e47cfbbacf99 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:17.019171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-acaa5e42-b777-431d-b15b-e47cfbbacf99 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:17.019621 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-acaa5e42-b777-431d-b15b-e47cfbbacf99 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:17.020402 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-acaa5e42-b777-431d-b15b-e47cfbbacf99 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:17.020823 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-acaa5e42-b777-431d-b15b-e47cfbbacf99 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:17.152465 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-acaa5e42-b777-431d-b15b-e47cfbbacf99 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:17.160554 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-acaa5e42-b777-431d-b15b-e47cfbbacf99 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.152165 Feb 21 02:32:17.161118 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 364/710] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:17 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:18.177776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-efc8b5cd-ff03-44bf-bbdf-bcc47a6b180e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:18.178644 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-efc8b5cd-ff03-44bf-bbdf-bcc47a6b180e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:18.185141 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efc8b5cd-ff03-44bf-bbdf-bcc47a6b180e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:18.185596 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efc8b5cd-ff03-44bf-bbdf-bcc47a6b180e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:18.186699 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efc8b5cd-ff03-44bf-bbdf-bcc47a6b180e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:18.187144 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-efc8b5cd-ff03-44bf-bbdf-bcc47a6b180e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:18.434789 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-efc8b5cd-ff03-44bf-bbdf-bcc47a6b180e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:18.442934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-efc8b5cd-ff03-44bf-bbdf-bcc47a6b180e tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.268673 Feb 21 02:32:18.443526 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 347/711] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:18 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:19.460061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9433f595-63f2-436e-af26-62c3b4338b84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:19.460670 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9433f595-63f2-436e-af26-62c3b4338b84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:19.466994 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9433f595-63f2-436e-af26-62c3b4338b84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:19.467422 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9433f595-63f2-436e-af26-62c3b4338b84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:19.468192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9433f595-63f2-436e-af26-62c3b4338b84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:19.468623 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9433f595-63f2-436e-af26-62c3b4338b84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:19.597877 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9433f595-63f2-436e-af26-62c3b4338b84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:19.604935 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9433f595-63f2-436e-af26-62c3b4338b84 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1318 microversion: 2.1 time: 0.148525 Feb 21 02:32:19.605500 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 365/712] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:19 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:20.622164 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7b43b208-39fc-4dc3-a7a5-6a1729a62ab6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:20.622764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7b43b208-39fc-4dc3-a7a5-6a1729a62ab6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:20.628475 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7b43b208-39fc-4dc3-a7a5-6a1729a62ab6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:20.628917 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7b43b208-39fc-4dc3-a7a5-6a1729a62ab6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:20.629706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7b43b208-39fc-4dc3-a7a5-6a1729a62ab6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:20.630136 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7b43b208-39fc-4dc3-a7a5-6a1729a62ab6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:20.759292 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7b43b208-39fc-4dc3-a7a5-6a1729a62ab6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:20.767378 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7b43b208-39fc-4dc3-a7a5-6a1729a62ab6 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1507 microversion: 2.1 time: 0.148951 Feb 21 02:32:20.767937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 348/713] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:20 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:20.783858 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b9f75f79-d36a-4659-be1d-0b9fa5c82e4f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "748e7d80-a55f-4e96-abf6-230a06455a3b", "device": "/dev/sdb"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:32:20.785453 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b9f75f79-d36a-4659-be1d-0b9fa5c82e4f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:20.791554 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9f75f79-d36a-4659-be1d-0b9fa5c82e4f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:20.792000 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9f75f79-d36a-4659-be1d-0b9fa5c82e4f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:20.792762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9f75f79-d36a-4659-be1d-0b9fa5c82e4f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:20.793193 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9f75f79-d36a-4659-be1d-0b9fa5c82e4f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:21.021713 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b9f75f79-d36a-4659-be1d-0b9fa5c82e4f tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "POST /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241987 Feb 21 02:32:21.022334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 366/714] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:32:20 2022] POST /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:32:39.601224 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:32:39.601976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: Mon Feb 21 02:32:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:32:48.455073 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-cf4dab05-fa82-47e5-bd37-a6eba226bb5c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:48.455672 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cf4dab05-fa82-47e5-bd37-a6eba226bb5c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:48.461978 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cf4dab05-fa82-47e5-bd37-a6eba226bb5c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:48.462421 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cf4dab05-fa82-47e5-bd37-a6eba226bb5c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:48.463187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cf4dab05-fa82-47e5-bd37-a6eba226bb5c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:48.463614 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cf4dab05-fa82-47e5-bd37-a6eba226bb5c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:48.689799 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-cf4dab05-fa82-47e5-bd37-a6eba226bb5c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lazy-loading 'services' on Instance uuid a6d57bba-d8da-48e6-a336-4a45b02a871d {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:32:48.756321 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-cf4dab05-fa82-47e5-bd37-a6eba226bb5c tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d/os-volume_attachments/748e7d80-a55f-4e96-abf6-230a06455a3b" status: 202 len: 0 microversion: 2.1 time: 0.305012 Feb 21 02:32:48.756973 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 349/715] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:32:48 2022] DELETE /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d/os-volume_attachments/748e7d80-a55f-4e96-abf6-230a06455a3b => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:32:49.864521 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7582e4c6-2f7a-4bdb-bd80-144dc61655fd tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:49.865103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7582e4c6-2f7a-4bdb-bd80-144dc61655fd tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:49.871263 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7582e4c6-2f7a-4bdb-bd80-144dc61655fd tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:49.871709 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7582e4c6-2f7a-4bdb-bd80-144dc61655fd tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:49.872480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7582e4c6-2f7a-4bdb-bd80-144dc61655fd tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:49.872913 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7582e4c6-2f7a-4bdb-bd80-144dc61655fd tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:49.897439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7582e4c6-2f7a-4bdb-bd80-144dc61655fd tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:32:49.967769 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7582e4c6-2f7a-4bdb-bd80-144dc61655fd tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 204 len: 0 microversion: 2.1 time: 0.107454 Feb 21 02:32:49.968716 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 367/716] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:32:49 2022] DELETE /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:32:49.977719 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-75283664-ff44-4429-93cc-304ce768e6fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:49.978417 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-75283664-ff44-4429-93cc-304ce768e6fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:49.985167 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-75283664-ff44-4429-93cc-304ce768e6fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:49.985610 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-75283664-ff44-4429-93cc-304ce768e6fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:49.986505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-75283664-ff44-4429-93cc-304ce768e6fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:49.986938 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-75283664-ff44-4429-93cc-304ce768e6fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:50.124686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-75283664-ff44-4429-93cc-304ce768e6fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:50.132002 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-75283664-ff44-4429-93cc-304ce768e6fc tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1513 microversion: 2.1 time: 0.159001 Feb 21 02:32:50.132566 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 350/717] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:49 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:51.150131 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-85193330-9983-40b2-aebc-b62b8a3a27d8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:51.150824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-85193330-9983-40b2-aebc-b62b8a3a27d8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:51.158021 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85193330-9983-40b2-aebc-b62b8a3a27d8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:51.158475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85193330-9983-40b2-aebc-b62b8a3a27d8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:51.159262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85193330-9983-40b2-aebc-b62b8a3a27d8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:51.159702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85193330-9983-40b2-aebc-b62b8a3a27d8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:51.391008 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-85193330-9983-40b2-aebc-b62b8a3a27d8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:51.398210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-85193330-9983-40b2-aebc-b62b8a3a27d8 tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1513 microversion: 2.1 time: 0.252054 Feb 21 02:32:51.398776 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 368/718] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:51 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:52.415132 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ba315e7c-92ae-428e-b6d4-2683d98b12ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:52.415736 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ba315e7c-92ae-428e-b6d4-2683d98b12ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:52.422597 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba315e7c-92ae-428e-b6d4-2683d98b12ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:52.423035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba315e7c-92ae-428e-b6d4-2683d98b12ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:52.423800 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba315e7c-92ae-428e-b6d4-2683d98b12ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:52.424229 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba315e7c-92ae-428e-b6d4-2683d98b12ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:52.555697 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ba315e7c-92ae-428e-b6d4-2683d98b12ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8518b2eaf3144249af9733b819aa27d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d4895c6155469e9922d6ad6e152051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:32:52.563467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ba315e7c-92ae-428e-b6d4-2683d98b12ce tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 200 len: 1513 microversion: 2.1 time: 0.152006 Feb 21 02:32:52.564024 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 351/719] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:52 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:32:53.097906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-1a27cad1-85f0-4f52-82a0-4655eac013f1 req-2085c465-1901-4ca0-beec-fda5850d670b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d57bba-d8da-48e6-a336-4a45b02a871d", "name": "network-vif-deleted", "tag": "962ea4ca-f539-43b8-b4bb-f284776dc2a8"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:32:53.099481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:32:53.099481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:32:53.106438 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-1a27cad1-85f0-4f52-82a0-4655eac013f1 req-2085c465-1901-4ca0-beec-fda5850d670b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:53.106890 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-1a27cad1-85f0-4f52-82a0-4655eac013f1 req-2085c465-1901-4ca0-beec-fda5850d670b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:53.118719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-1a27cad1-85f0-4f52-82a0-4655eac013f1 req-2085c465-1901-4ca0-beec-fda5850d670b service nova] Creating event network-vif-deleted:962ea4ca-f539-43b8-b4bb-f284776dc2a8 for instance a6d57bba-d8da-48e6-a336-4a45b02a871d on hv-cinder-80447 Feb 21 02:32:53.123812 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-1a27cad1-85f0-4f52-82a0-4655eac013f1 req-2085c465-1901-4ca0-beec-fda5850d670b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088693 Feb 21 02:32:53.124390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 369/720] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:32:53.580698 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:32:53.581487 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] [instance: a6d57bba-d8da-48e6-a336-4a45b02a871d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:32:53.588160 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:53.588605 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:53.589371 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:32:53.589831 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:32:53.603750 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] HTTP exception thrown: Instance a6d57bba-d8da-48e6-a336-4a45b02a871d could not be found. Feb 21 02:32:53.604357 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] Returning 404 to user: Instance a6d57bba-d8da-48e6-a336-4a45b02a871d could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:32:53.605415 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3c138dbd-8303-4e9d-a3f4-0804e3354a1a tempest-VolumesSnapshotTestJSON-1495969465 tempest-VolumesSnapshotTestJSON-1495969465-project] 10.222.0.75 "GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d" status: 404 len: 111 microversion: 2.1 time: 0.029008 Feb 21 02:32:53.606072 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 352/721] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:32:53 2022] GET /compute/v2.1/servers/a6d57bba-d8da-48e6-a336-4a45b02a871d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:33:48.533029 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b920b35b-9977-44ae-9690-ece6cd6da667 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:33:48.533609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b920b35b-9977-44ae-9690-ece6cd6da667 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:33:48.539864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b920b35b-9977-44ae-9690-ece6cd6da667 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:48.540314 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b920b35b-9977-44ae-9690-ece6cd6da667 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:48.541106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b920b35b-9977-44ae-9690-ece6cd6da667 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:48.541546 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b920b35b-9977-44ae-9690-ece6cd6da667 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:48.618895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-b920b35b-9977-44ae-9690-ece6cd6da667 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lazy-loading 'services' on Instance uuid 2af65eb3-dbe6-4a66-919e-c8a6884b613c {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:33:48.688236 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b920b35b-9977-44ae-9690-ece6cd6da667 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/os-volume_attachments/896b4051-2e61-40c0-a16c-34f6fd542bf4" status: 202 len: 0 microversion: 2.1 time: 0.314274 Feb 21 02:33:48.688813 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 370/722] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:33:48 2022] DELETE /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/os-volume_attachments/896b4051-2e61-40c0-a16c-34f6fd542bf4 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:33:55.043405 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-87fc1daf-de6b-41fe-950a-e1808aaeaa4d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:33:55.049209 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-87fc1daf-de6b-41fe-950a-e1808aaeaa4d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:55.049529 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-87fc1daf-de6b-41fe-950a-e1808aaeaa4d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:55.072517 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-87fc1daf-de6b-41fe-950a-e1808aaeaa4d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Going to try to stop instance {{(pid=116710) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 02:33:55.113996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-87fc1daf-de6b-41fe-950a-e1808aaeaa4d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/action" status: 202 len: 0 microversion: 2.1 time: 0.075284 Feb 21 02:33:55.114779 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 353/723] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:33:55 2022] POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:33:55.124267 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5938d3ad-8d93-4567-970b-36de0fb9d807 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:33:55.124958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5938d3ad-8d93-4567-970b-36de0fb9d807 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:33:55.133208 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5938d3ad-8d93-4567-970b-36de0fb9d807 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:55.133685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5938d3ad-8d93-4567-970b-36de0fb9d807 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:55.134724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5938d3ad-8d93-4567-970b-36de0fb9d807 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:55.135167 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5938d3ad-8d93-4567-970b-36de0fb9d807 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:55.270056 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5938d3ad-8d93-4567-970b-36de0fb9d807 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:33:55.277473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5938d3ad-8d93-4567-970b-36de0fb9d807 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.157128 Feb 21 02:33:55.278075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 371/724] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:33:55 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:33:56.295091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0e5dd69e-ff19-4bee-80c2-c279af267f67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:33:56.295780 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0e5dd69e-ff19-4bee-80c2-c279af267f67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:33:56.302305 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0e5dd69e-ff19-4bee-80c2-c279af267f67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:56.302747 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0e5dd69e-ff19-4bee-80c2-c279af267f67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:56.303584 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0e5dd69e-ff19-4bee-80c2-c279af267f67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:56.304063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0e5dd69e-ff19-4bee-80c2-c279af267f67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:56.437617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0e5dd69e-ff19-4bee-80c2-c279af267f67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:33:56.445208 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0e5dd69e-ff19-4bee-80c2-c279af267f67 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.153982 Feb 21 02:33:56.445872 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 354/725] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:33:56 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:33:57.463094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-547c946a-62df-4d0a-900c-90407cda1f71 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:33:57.463607 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-547c946a-62df-4d0a-900c-90407cda1f71 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:33:57.469845 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-547c946a-62df-4d0a-900c-90407cda1f71 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:57.470289 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-547c946a-62df-4d0a-900c-90407cda1f71 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:57.471061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-547c946a-62df-4d0a-900c-90407cda1f71 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:57.471488 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-547c946a-62df-4d0a-900c-90407cda1f71 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:57.620228 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-547c946a-62df-4d0a-900c-90407cda1f71 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:33:57.627834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-547c946a-62df-4d0a-900c-90407cda1f71 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.169327 Feb 21 02:33:57.628400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 372/726] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:33:57 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:33:58.645865 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e2649c43-0a92-4568-b84a-995455b09730 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:33:58.646584 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e2649c43-0a92-4568-b84a-995455b09730 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:33:58.653557 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2649c43-0a92-4568-b84a-995455b09730 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:58.654096 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2649c43-0a92-4568-b84a-995455b09730 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:58.654929 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2649c43-0a92-4568-b84a-995455b09730 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:58.655362 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e2649c43-0a92-4568-b84a-995455b09730 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:58.799836 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e2649c43-0a92-4568-b84a-995455b09730 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:33:58.807737 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e2649c43-0a92-4568-b84a-995455b09730 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.165666 Feb 21 02:33:58.808292 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 355/727] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:33:58 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:33:59.824793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b42cd87c-5a57-4d00-b919-2699603cd639 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:33:59.825460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b42cd87c-5a57-4d00-b919-2699603cd639 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:33:59.831724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b42cd87c-5a57-4d00-b919-2699603cd639 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:59.832175 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b42cd87c-5a57-4d00-b919-2699603cd639 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:59.832955 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b42cd87c-5a57-4d00-b919-2699603cd639 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:33:59.833391 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b42cd87c-5a57-4d00-b919-2699603cd639 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:33:59.979061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b42cd87c-5a57-4d00-b919-2699603cd639 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:33:59.986449 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b42cd87c-5a57-4d00-b919-2699603cd639 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.165470 Feb 21 02:33:59.987014 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 373/728] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:33:59 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:01.003587 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5b3e32b4-af12-406f-b415-a1345bb05cd6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:01.004282 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5b3e32b4-af12-406f-b415-a1345bb05cd6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:01.011340 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5b3e32b4-af12-406f-b415-a1345bb05cd6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:01.012050 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5b3e32b4-af12-406f-b415-a1345bb05cd6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:01.012847 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5b3e32b4-af12-406f-b415-a1345bb05cd6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:01.013286 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5b3e32b4-af12-406f-b415-a1345bb05cd6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:01.155793 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5b3e32b4-af12-406f-b415-a1345bb05cd6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:01.164153 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5b3e32b4-af12-406f-b415-a1345bb05cd6 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.164129 Feb 21 02:34:01.164774 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 356/729] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:00 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:02.181668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2892030b-3157-42be-a37b-9390448000d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:02.182274 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2892030b-3157-42be-a37b-9390448000d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:02.188484 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2892030b-3157-42be-a37b-9390448000d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:02.188941 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2892030b-3157-42be-a37b-9390448000d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:02.189743 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2892030b-3157-42be-a37b-9390448000d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:02.190189 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2892030b-3157-42be-a37b-9390448000d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:02.337219 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2892030b-3157-42be-a37b-9390448000d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:02.344849 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2892030b-3157-42be-a37b-9390448000d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.167789 Feb 21 02:34:02.345426 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 374/730] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:02 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:03.363041 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9e325f19-c70b-4096-9dc6-e97926be8ca2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:03.363728 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9e325f19-c70b-4096-9dc6-e97926be8ca2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:03.370087 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e325f19-c70b-4096-9dc6-e97926be8ca2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:03.370546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e325f19-c70b-4096-9dc6-e97926be8ca2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:03.371334 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e325f19-c70b-4096-9dc6-e97926be8ca2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:03.371943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9e325f19-c70b-4096-9dc6-e97926be8ca2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:03.566686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9e325f19-c70b-4096-9dc6-e97926be8ca2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:03.575272 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9e325f19-c70b-4096-9dc6-e97926be8ca2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.215998 Feb 21 02:34:03.575850 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 357/731] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:03 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:04.592812 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ea4aa60d-6b92-44e7-b9b5-dc554adab175 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:04.593429 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ea4aa60d-6b92-44e7-b9b5-dc554adab175 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:04.600069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea4aa60d-6b92-44e7-b9b5-dc554adab175 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:04.600892 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea4aa60d-6b92-44e7-b9b5-dc554adab175 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:04.601332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea4aa60d-6b92-44e7-b9b5-dc554adab175 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:04.601879 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea4aa60d-6b92-44e7-b9b5-dc554adab175 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:04.823947 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ea4aa60d-6b92-44e7-b9b5-dc554adab175 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:04.847007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ea4aa60d-6b92-44e7-b9b5-dc554adab175 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1677 microversion: 2.1 time: 0.256947 Feb 21 02:34:04.847007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 375/732] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:04 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:05.866857 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7d9aa44d-e746-4749-b04f-0def2b82536b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:05.867626 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7d9aa44d-e746-4749-b04f-0def2b82536b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:05.874444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7d9aa44d-e746-4749-b04f-0def2b82536b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:05.874889 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7d9aa44d-e746-4749-b04f-0def2b82536b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:05.875922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7d9aa44d-e746-4749-b04f-0def2b82536b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:05.876363 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7d9aa44d-e746-4749-b04f-0def2b82536b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:06.024638 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7d9aa44d-e746-4749-b04f-0def2b82536b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:06.032481 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7d9aa44d-e746-4749-b04f-0def2b82536b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1654 microversion: 2.1 time: 0.171446 Feb 21 02:34:06.033588 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 358/733] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:05 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1654 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:06.049534 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fa2db6ac-3dae-483d-b4d5-cc8b86ccdf4a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:06.056904 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa2db6ac-3dae-483d-b4d5-cc8b86ccdf4a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:06.057582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa2db6ac-3dae-483d-b4d5-cc8b86ccdf4a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:06.080833 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fa2db6ac-3dae-483d-b4d5-cc8b86ccdf4a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Going to try to start instance {{(pid=116711) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 02:34:06.141487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fa2db6ac-3dae-483d-b4d5-cc8b86ccdf4a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/action" status: 202 len: 0 microversion: 2.1 time: 0.095222 Feb 21 02:34:06.153455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b563dca0-e865-4114-b90e-d0581978987d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:06.154338 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b563dca0-e865-4114-b90e-d0581978987d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:06.159766 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 376/734] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:34:06 2022] POST /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:34:06.161673 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b563dca0-e865-4114-b90e-d0581978987d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:06.162265 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b563dca0-e865-4114-b90e-d0581978987d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:06.164506 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b563dca0-e865-4114-b90e-d0581978987d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:06.165135 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b563dca0-e865-4114-b90e-d0581978987d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:06.435452 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b563dca0-e865-4114-b90e-d0581978987d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:06.446079 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b563dca0-e865-4114-b90e-d0581978987d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1663 microversion: 2.1 time: 0.297603 Feb 21 02:34:06.447262 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 359/735] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:06 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1663 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:07.464995 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-82c4ed56-2395-4cc3-bb8f-2a4fa31e6507 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:07.465634 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-82c4ed56-2395-4cc3-bb8f-2a4fa31e6507 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:07.473498 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-82c4ed56-2395-4cc3-bb8f-2a4fa31e6507 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:07.474237 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-82c4ed56-2395-4cc3-bb8f-2a4fa31e6507 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:07.475787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-82c4ed56-2395-4cc3-bb8f-2a4fa31e6507 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:07.476420 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-82c4ed56-2395-4cc3-bb8f-2a4fa31e6507 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:07.697623 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-82c4ed56-2395-4cc3-bb8f-2a4fa31e6507 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:07.714745 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-82c4ed56-2395-4cc3-bb8f-2a4fa31e6507 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1663 microversion: 2.1 time: 0.254682 Feb 21 02:34:07.727177 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 377/736] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:07 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1663 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:08.737701 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b000bb07-3cb8-4792-b36a-64290fa54f6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:08.738830 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b000bb07-3cb8-4792-b36a-64290fa54f6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:08.746075 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b000bb07-3cb8-4792-b36a-64290fa54f6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:08.746668 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b000bb07-3cb8-4792-b36a-64290fa54f6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:08.747452 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b000bb07-3cb8-4792-b36a-64290fa54f6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:08.748057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b000bb07-3cb8-4792-b36a-64290fa54f6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:08.935720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b000bb07-3cb8-4792-b36a-64290fa54f6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:08.947460 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b000bb07-3cb8-4792-b36a-64290fa54f6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1667 microversion: 2.1 time: 0.216110 Feb 21 02:34:08.948044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 360/737] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:08 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1667 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:21.535156 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a1db3455-2aac-4de5-b8a4-1ccf0daa3dad tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:21.535780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a1db3455-2aac-4de5-b8a4-1ccf0daa3dad tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:21.543123 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a1db3455-2aac-4de5-b8a4-1ccf0daa3dad tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:21.543775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a1db3455-2aac-4de5-b8a4-1ccf0daa3dad tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:21.544671 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a1db3455-2aac-4de5-b8a4-1ccf0daa3dad tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:21.545177 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a1db3455-2aac-4de5-b8a4-1ccf0daa3dad tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:21.573691 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-a1db3455-2aac-4de5-b8a4-1ccf0daa3dad tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lazy-loading 'flavor' on Instance uuid a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:34:21.937023 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a1db3455-2aac-4de5-b8a4-1ccf0daa3dad tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/action" status: 202 len: 0 microversion: 2.20 time: 0.405811 Feb 21 02:34:21.937684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 378/738] 10.222.0.75 () {62 vars in 1318 bytes} [Mon Feb 21 02:34:21 2022] POST /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:34:21.947156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:21.948693 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:21.955436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:21.955897 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:21.956847 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:21.957331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:22.134062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:22.142106 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:22.143602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:22.144760 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fba14046-6c90-4322-9e44-d6c12e3eabcd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.202448 Feb 21 02:34:22.145307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 361/739] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:21 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:22.233005 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-96cb5224-248c-4e7a-9de0-04a18ed4ec1b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Action: 'create', calling method: .version_select at 0x7fd85c06dd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-800918390"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:22.247586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-96cb5224-248c-4e7a-9de0-04a18ed4ec1b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Getting quotas for project e36f98f3ada743f7be39257e917a12c9. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:34:22.251479 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-96cb5224-248c-4e7a-9de0-04a18ed4ec1b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Getting quotas for user 39c5ea77bceb4a15bf41fe88d0665040 and project e36f98f3ada743f7be39257e917a12c9. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:34:22.595579 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-96cb5224-248c-4e7a-9de0-04a18ed4ec1b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Getting quotas for project e36f98f3ada743f7be39257e917a12c9. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:34:22.599091 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-96cb5224-248c-4e7a-9de0-04a18ed4ec1b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Getting quotas for user 39c5ea77bceb4a15bf41fe88d0665040 and project e36f98f3ada743f7be39257e917a12c9. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:34:22.612367 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-96cb5224-248c-4e7a-9de0-04a18ed4ec1b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.383355 Feb 21 02:34:22.612973 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 379/740] 10.222.0.75 () {60 vars in 1157 bytes} [Mon Feb 21 02:34:22 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:22.659707 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1816910164", "imageRef": "29b30512-eeae-4491-a13b-65d4d88320a5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-800918390", "networks": [{"uuid": "a46c34e7-6a38-4255-86f4-6a2d2cc0462d"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:22.707157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] validate_networks() for [('a46c34e7-6a38-4255-86f4-6a2d2cc0462d', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:34:23.157319 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:34:23.157931 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:34:23.158250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:34:23.158768 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:34:23.159183 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:34:23.163416 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:23.164138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:23.169235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:23.169715 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:23.170043 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:23.170487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:23.170603 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:23.171033 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:23.171254 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:23.171682 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:23.187577 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Getting quotas for project e36f98f3ada743f7be39257e917a12c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:34:23.191496 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Getting quotas for user 39c5ea77bceb4a15bf41fe88d0665040 and project e36f98f3ada743f7be39257e917a12c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:34:23.202357 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:34:23.204639 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='29b30512-eeae-4491-a13b-65d4d88320a5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:34:23.250923 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-af46c0be-4cc8-4d9d-b822-fc74810f54cb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594757 Feb 21 02:34:23.251758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 362/741] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:34:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:34:23.261387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fafc5d33-a51b-48dd-b715-a3cdd14ca053 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:23.262030 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fafc5d33-a51b-48dd-b715-a3cdd14ca053 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:23.323643 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:23.326957 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fafc5d33-a51b-48dd-b715-a3cdd14ca053 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:23.333317 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:23.334917 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fafc5d33-a51b-48dd-b715-a3cdd14ca053 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1258 microversion: 2.1 time: 0.077418 Feb 21 02:34:23.335638 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:23.336314 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 363/742] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:23 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:23.336798 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fa86a9af-a099-4456-bf53-0743b28c5392 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.177557 Feb 21 02:34:23.337342 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 380/743] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:23 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:24.352470 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ca96c3c7-f4c9-4f3e-9207-e673ca1d40af tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:24.353786 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ca96c3c7-f4c9-4f3e-9207-e673ca1d40af tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:24.356242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:24.358745 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:24.362357 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca96c3c7-f4c9-4f3e-9207-e673ca1d40af tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:24.363009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca96c3c7-f4c9-4f3e-9207-e673ca1d40af tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:24.364137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca96c3c7-f4c9-4f3e-9207-e673ca1d40af tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:24.364751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ca96c3c7-f4c9-4f3e-9207-e673ca1d40af tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:24.368684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:24.369407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:24.370636 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:24.371182 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:24.454154 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ca96c3c7-f4c9-4f3e-9207-e673ca1d40af tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:24.465527 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ca96c3c7-f4c9-4f3e-9207-e673ca1d40af tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1328 microversion: 2.1 time: 0.117337 Feb 21 02:34:24.466186 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 364/744] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:24 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:24.521300 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:24.529093 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:24.530617 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:24.531756 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-09e4c673-0851-4170-9e3f-fcf425480dda tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.179519 Feb 21 02:34:24.532305 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 381/745] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:24 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:25.483641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-90f1c3f2-2422-485d-add4-632ecc579134 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:25.484308 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-90f1c3f2-2422-485d-add4-632ecc579134 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:25.492138 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-90f1c3f2-2422-485d-add4-632ecc579134 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:25.492580 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-90f1c3f2-2422-485d-add4-632ecc579134 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:25.493367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-90f1c3f2-2422-485d-add4-632ecc579134 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:25.494020 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-90f1c3f2-2422-485d-add4-632ecc579134 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:25.550450 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:25.551192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:25.559716 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:25.560171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:25.560983 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:25.561423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:25.641156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-90f1c3f2-2422-485d-add4-632ecc579134 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:25.649127 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-90f1c3f2-2422-485d-add4-632ecc579134 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.169529 Feb 21 02:34:25.649727 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 365/746] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:25 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:25.733150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:25.742315 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:25.743791 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:25.745192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fc305f59-8d2f-4821-9030-acb86eb46eec tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.198468 Feb 21 02:34:25.745797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 382/747] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:25 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:26.666829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-61910562-0acc-400d-ba23-577f934cc80f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:26.667745 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-61910562-0acc-400d-ba23-577f934cc80f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:26.674896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-61910562-0acc-400d-ba23-577f934cc80f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:26.675443 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-61910562-0acc-400d-ba23-577f934cc80f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:26.676311 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-61910562-0acc-400d-ba23-577f934cc80f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:26.676950 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-61910562-0acc-400d-ba23-577f934cc80f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:26.765553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:26.766223 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:26.773389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:26.773875 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:26.774667 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:26.775100 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:26.838300 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-61910562-0acc-400d-ba23-577f934cc80f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:26.847556 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-61910562-0acc-400d-ba23-577f934cc80f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.184235 Feb 21 02:34:26.848149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 366/748] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:26 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:26.928811 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:26.938554 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:26.940119 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:26.941305 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c2bfc1af-9744-42a2-8dc5-3cdae7daca9d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.180514 Feb 21 02:34:26.942064 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 383/749] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:26 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:27.864369 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-38a302bb-8621-417f-bf5d-d4b9688a8abb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:27.865721 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-38a302bb-8621-417f-bf5d-d4b9688a8abb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:27.872144 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38a302bb-8621-417f-bf5d-d4b9688a8abb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:27.872587 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38a302bb-8621-417f-bf5d-d4b9688a8abb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:27.873363 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38a302bb-8621-417f-bf5d-d4b9688a8abb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:27.873818 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-38a302bb-8621-417f-bf5d-d4b9688a8abb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:27.960287 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:27.960921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:27.972352 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:27.972795 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:27.973578 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:27.974057 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:28.019233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-38a302bb-8621-417f-bf5d-d4b9688a8abb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:28.031614 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-38a302bb-8621-417f-bf5d-d4b9688a8abb tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.170696 Feb 21 02:34:28.042343 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 367/750] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:27 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:28.137371 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:28.145672 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:28.147830 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:28.149018 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6db230d4-61d2-4633-97fb-04a641994981 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.192890 Feb 21 02:34:28.149685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 384/751] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:27 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:29.049797 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-40eec767-714e-42f2-9baa-de1406b30223 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:29.050399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-40eec767-714e-42f2-9baa-de1406b30223 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:29.056939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-40eec767-714e-42f2-9baa-de1406b30223 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:29.057384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-40eec767-714e-42f2-9baa-de1406b30223 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:29.058202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-40eec767-714e-42f2-9baa-de1406b30223 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:29.058631 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-40eec767-714e-42f2-9baa-de1406b30223 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:29.167082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:29.167703 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:29.174210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:29.174918 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:29.176069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:29.176701 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:29.204151 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-40eec767-714e-42f2-9baa-de1406b30223 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:29.212241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-40eec767-714e-42f2-9baa-de1406b30223 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.166109 Feb 21 02:34:29.212959 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 368/752] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:29 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:29.333567 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:29.341929 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:29.343408 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:29.344558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c72b88d5-f740-4c94-8270-7daa59172afd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.181144 Feb 21 02:34:29.345306 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 385/753] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:29 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:30.230987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a01a0e85-f41f-4413-b80c-0dccd6537635 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:30.231551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a01a0e85-f41f-4413-b80c-0dccd6537635 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:30.238398 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a01a0e85-f41f-4413-b80c-0dccd6537635 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:30.238837 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a01a0e85-f41f-4413-b80c-0dccd6537635 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:30.239616 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a01a0e85-f41f-4413-b80c-0dccd6537635 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:30.240085 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a01a0e85-f41f-4413-b80c-0dccd6537635 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:30.365748 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:30.367058 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:30.374114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:30.374651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:30.375530 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:30.376151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:30.387590 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a01a0e85-f41f-4413-b80c-0dccd6537635 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:30.395798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a01a0e85-f41f-4413-b80c-0dccd6537635 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.168445 Feb 21 02:34:30.405822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 369/754] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:30 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:30.530280 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:30.538921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:30.540518 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:30.541718 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1e122df5-4440-4cc3-9d1b-945f247ade14 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.181355 Feb 21 02:34:30.542457 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 386/755] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:30 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:31.413989 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-928adf21-e673-431b-9b68-7ee6ae8eed0d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:31.414624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-928adf21-e673-431b-9b68-7ee6ae8eed0d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:31.420864 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-928adf21-e673-431b-9b68-7ee6ae8eed0d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:31.421307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-928adf21-e673-431b-9b68-7ee6ae8eed0d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:31.422175 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-928adf21-e673-431b-9b68-7ee6ae8eed0d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:31.422607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-928adf21-e673-431b-9b68-7ee6ae8eed0d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:31.559769 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:31.560378 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:31.566546 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:31.566990 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:31.567869 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:31.568812 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:31.569238 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-928adf21-e673-431b-9b68-7ee6ae8eed0d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:31.576658 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-928adf21-e673-431b-9b68-7ee6ae8eed0d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.166341 Feb 21 02:34:31.577438 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 370/756] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:31 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:31.714491 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:31.722466 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:31.724843 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:31.726452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8ac3b266-b233-45af-a73f-b2b32ad9454f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.170367 Feb 21 02:34:31.738271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 387/757] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:31 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:32.593432 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b0937c19-cb13-49bf-b63f-b5a9924d6919 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:32.594046 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b0937c19-cb13-49bf-b63f-b5a9924d6919 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:32.601750 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0937c19-cb13-49bf-b63f-b5a9924d6919 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:32.602208 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0937c19-cb13-49bf-b63f-b5a9924d6919 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:32.602999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0937c19-cb13-49bf-b63f-b5a9924d6919 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:32.603439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0937c19-cb13-49bf-b63f-b5a9924d6919 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:32.746392 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:32.746987 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:32.748120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b0937c19-cb13-49bf-b63f-b5a9924d6919 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:32.753633 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:32.754182 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:32.755133 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:32.755739 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:32.755858 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b0937c19-cb13-49bf-b63f-b5a9924d6919 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.166106 Feb 21 02:34:32.756401 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 371/758] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:32 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:32.893086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:32.901293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:32.902812 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:32.903974 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a52b73f0-8b23-4907-8299-93d8ee1defd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.161338 Feb 21 02:34:32.904534 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 388/759] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:32 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:33.772217 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a5a41ab5-96e7-42e9-b3bf-0fee9c3039d6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:33.772822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a5a41ab5-96e7-42e9-b3bf-0fee9c3039d6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:33.779232 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a5a41ab5-96e7-42e9-b3bf-0fee9c3039d6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:33.779687 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a5a41ab5-96e7-42e9-b3bf-0fee9c3039d6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:33.780499 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a5a41ab5-96e7-42e9-b3bf-0fee9c3039d6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:33.780976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a5a41ab5-96e7-42e9-b3bf-0fee9c3039d6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:33.914257 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a5a41ab5-96e7-42e9-b3bf-0fee9c3039d6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:33.922026 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a5a41ab5-96e7-42e9-b3bf-0fee9c3039d6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.153575 Feb 21 02:34:33.922195 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:33.922757 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:33.923040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 372/760] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:33 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:33.929719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:33.930264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:33.931113 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:33.931618 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:34.064375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:34.072748 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:34.074243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:34.075383 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fe16c1ad-0b29-4efe-88b2-916de0d75fc6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.156820 Feb 21 02:34:34.075945 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 389/761] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:33 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:34.939383 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ea5b85e8-f795-45e3-82d1-da17c69cfe91 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:34.940005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ea5b85e8-f795-45e3-82d1-da17c69cfe91 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:34.946667 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ea5b85e8-f795-45e3-82d1-da17c69cfe91 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:34.947130 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ea5b85e8-f795-45e3-82d1-da17c69cfe91 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:34.947892 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ea5b85e8-f795-45e3-82d1-da17c69cfe91 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:34.948322 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ea5b85e8-f795-45e3-82d1-da17c69cfe91 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:35.085753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ea5b85e8-f795-45e3-82d1-da17c69cfe91 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:35.092952 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ea5b85e8-f795-45e3-82d1-da17c69cfe91 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.157182 Feb 21 02:34:35.093345 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:35.093853 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 373/762] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:34 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:35.094124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:35.100670 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:35.101125 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:35.101954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:35.102383 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:35.231573 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:35.239545 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:35.241991 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:35.243176 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d6d5c8f9-ba91-4b5a-a8f8-9ff6de1fda3c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.153459 Feb 21 02:34:35.243740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 390/763] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:35 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:36.109092 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4a78665c-88d9-49e7-a664-65f8359ad379 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:36.110013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4a78665c-88d9-49e7-a664-65f8359ad379 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:36.116392 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4a78665c-88d9-49e7-a664-65f8359ad379 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:36.116833 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4a78665c-88d9-49e7-a664-65f8359ad379 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:36.117602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4a78665c-88d9-49e7-a664-65f8359ad379 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:36.118069 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4a78665c-88d9-49e7-a664-65f8359ad379 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:36.250921 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4a78665c-88d9-49e7-a664-65f8359ad379 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:36.258192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4a78665c-88d9-49e7-a664-65f8359ad379 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.152699 Feb 21 02:34:36.258762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 374/764] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:36 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:36.261392 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:36.262027 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:36.268147 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:36.268591 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:36.269358 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:36.269817 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:36.405457 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:36.413268 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:36.414779 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:36.415947 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-06a455e6-86b1-4dd2-80c0-0e91ad89eb31 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.158312 Feb 21 02:34:36.416495 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 391/765] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:36 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:37.102152 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-8d861ee8-2006-41a7-97b5-fe5f49307c29 req-d63f59de-c4f6-46cd-bf2b-3fcd88df7f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba884d36-ccad-4dd6-8135-6f7bfc55077c", "tag": "ae827098-b4d8-4d85-b652-12a13456ab7e"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:37.104236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:34:37.104236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:34:37.111373 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-8d861ee8-2006-41a7-97b5-fe5f49307c29 req-d63f59de-c4f6-46cd-bf2b-3fcd88df7f5c service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:37.112006 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-8d861ee8-2006-41a7-97b5-fe5f49307c29 req-d63f59de-c4f6-46cd-bf2b-3fcd88df7f5c service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:37.124219 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-8d861ee8-2006-41a7-97b5-fe5f49307c29 req-d63f59de-c4f6-46cd-bf2b-3fcd88df7f5c service nova] Creating event network-changed:ae827098-b4d8-4d85-b652-12a13456ab7e for instance ba884d36-ccad-4dd6-8135-6f7bfc55077c on hv-cinder-80447 Feb 21 02:34:37.134720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-8d861ee8-2006-41a7-97b5-fe5f49307c29 req-d63f59de-c4f6-46cd-bf2b-3fcd88df7f5c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037129 Feb 21 02:34:37.135516 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 375/766] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:34:37.274952 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d0b98398-81e4-4c8a-8509-0a62617c7043 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:37.275559 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d0b98398-81e4-4c8a-8509-0a62617c7043 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:37.281567 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d0b98398-81e4-4c8a-8509-0a62617c7043 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:37.282114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d0b98398-81e4-4c8a-8509-0a62617c7043 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:37.282898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d0b98398-81e4-4c8a-8509-0a62617c7043 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:37.283338 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d0b98398-81e4-4c8a-8509-0a62617c7043 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:37.417266 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d0b98398-81e4-4c8a-8509-0a62617c7043 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:37.424494 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d0b98398-81e4-4c8a-8509-0a62617c7043 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.153520 Feb 21 02:34:37.425067 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 392/767] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:37 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:37.435311 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:37.436025 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:37.442063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:37.442541 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:37.443333 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:37.443737 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:37.672668 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:37.680780 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:37.682389 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:37.683611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-855dda88-784a-41de-be39-9ca8aeb91140 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.252493 Feb 21 02:34:37.684255 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 376/768] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:37 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:38.442427 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5f06ef63-0648-4fa9-b32f-30c401fe7992 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:38.443036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5f06ef63-0648-4fa9-b32f-30c401fe7992 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:38.450145 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5f06ef63-0648-4fa9-b32f-30c401fe7992 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:38.450595 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5f06ef63-0648-4fa9-b32f-30c401fe7992 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:38.451364 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5f06ef63-0648-4fa9-b32f-30c401fe7992 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:38.451803 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5f06ef63-0648-4fa9-b32f-30c401fe7992 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:38.581653 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5f06ef63-0648-4fa9-b32f-30c401fe7992 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:38.588981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5f06ef63-0648-4fa9-b32f-30c401fe7992 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.150192 Feb 21 02:34:38.589552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 393/769] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:38 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:38.702170 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:38.702775 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:38.709127 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:38.709835 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:38.710615 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:38.711049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:38.842050 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:38.850264 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:38.851753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:38.852890 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-155b884b-9af9-43ac-8af6-b67c97ce42a1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1746 microversion: 2.20 time: 0.154450 Feb 21 02:34:38.853446 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 377/770] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:38 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:39.605332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-63554c1d-3396-45bd-a7ee-8c0f97c468c6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:39.605965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-63554c1d-3396-45bd-a7ee-8c0f97c468c6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:39.612797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-63554c1d-3396-45bd-a7ee-8c0f97c468c6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:39.613593 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-63554c1d-3396-45bd-a7ee-8c0f97c468c6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:39.614490 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-63554c1d-3396-45bd-a7ee-8c0f97c468c6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:39.614925 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-63554c1d-3396-45bd-a7ee-8c0f97c468c6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:39.753607 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-63554c1d-3396-45bd-a7ee-8c0f97c468c6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:39.761388 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-63554c1d-3396-45bd-a7ee-8c0f97c468c6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.159696 Feb 21 02:34:39.762001 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 394/771] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:39 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:39.871302 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:39.871909 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:39.878149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:39.878598 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:39.879371 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:39.879804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:40.010345 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:40.017938 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:40.019414 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:40.020546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e954f56a-39a3-4480-a353-371dc423490e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1746 microversion: 2.20 time: 0.152941 Feb 21 02:34:40.021104 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 378/772] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:39 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:40.777369 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-caa5c48f-78b5-4ee8-a765-4e90d33944aa tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:40.778005 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-caa5c48f-78b5-4ee8-a765-4e90d33944aa tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:40.784247 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-caa5c48f-78b5-4ee8-a765-4e90d33944aa tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:40.784692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-caa5c48f-78b5-4ee8-a765-4e90d33944aa tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:40.785466 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-caa5c48f-78b5-4ee8-a765-4e90d33944aa tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:40.785939 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-caa5c48f-78b5-4ee8-a765-4e90d33944aa tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:40.921074 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-caa5c48f-78b5-4ee8-a765-4e90d33944aa tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:40.928309 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-caa5c48f-78b5-4ee8-a765-4e90d33944aa tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.154572 Feb 21 02:34:40.928866 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 395/773] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:40 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:41.038720 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:41.039608 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:41.045910 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.046364 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:41.047152 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.047586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:41.193084 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:41.201324 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:41.202821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:41.204044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-cec7a28c-1c4d-4a53-b01f-6e75660fa268 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1746 microversion: 2.20 time: 0.169171 Feb 21 02:34:41.204716 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 396/774] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:41 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:41.214465 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-02a5bbad-c424-4faa-94b3-f926de719640 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:41.215824 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-02a5bbad-c424-4faa-94b3-f926de719640 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:41.221600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02a5bbad-c424-4faa-94b3-f926de719640 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.222082 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02a5bbad-c424-4faa-94b3-f926de719640 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:41.222861 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02a5bbad-c424-4faa-94b3-f926de719640 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.223291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02a5bbad-c424-4faa-94b3-f926de719640 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:41.247610 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-02a5bbad-c424-4faa-94b3-f926de719640 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lazy-loading 'flavor' on Instance uuid 28fd287f-356c-4485-ba82-bbe3da3cf5ba {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:34:41.323913 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-02a5bbad-c424-4faa-94b3-f926de719640 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "POST /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba/action" status: 202 len: 0 microversion: 2.1 time: 0.308465 Feb 21 02:34:41.327729 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 379/775] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:34:41 2022] POST /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:34:41.336100 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ed5d53fb-da5e-4e71-b1a5-2ea14e9bf02b tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:41.337250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ed5d53fb-da5e-4e71-b1a5-2ea14e9bf02b tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:41.344455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ed5d53fb-da5e-4e71-b1a5-2ea14e9bf02b tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.344680 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ed5d53fb-da5e-4e71-b1a5-2ea14e9bf02b tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:41.345493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ed5d53fb-da5e-4e71-b1a5-2ea14e9bf02b tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.346019 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ed5d53fb-da5e-4e71-b1a5-2ea14e9bf02b tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:41.394601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-2f48a443-cf7a-4dd2-a16b-f0922f101672 req-b7013c1a-e293-4085-bc91-9f750c620884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8e707-e1a8-46b8-8b47-ef1d9ef77903", "name": "network-vif-plugged", "status": "completed", "tag": "186e3f15-c158-44f9-a144-358d5ab62c8f"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:41.396845 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:34:41.396845 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:34:41.405076 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-2f48a443-cf7a-4dd2-a16b-f0922f101672 req-b7013c1a-e293-4085-bc91-9f750c620884 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.405515 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-2f48a443-cf7a-4dd2-a16b-f0922f101672 req-b7013c1a-e293-4085-bc91-9f750c620884 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:41.419703 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-2f48a443-cf7a-4dd2-a16b-f0922f101672 req-b7013c1a-e293-4085-bc91-9f750c620884 service nova] Creating event network-vif-plugged:186e3f15-c158-44f9-a144-358d5ab62c8f for instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 on hv-cinder-80447 Feb 21 02:34:41.425313 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-2f48a443-cf7a-4dd2-a16b-f0922f101672 req-b7013c1a-e293-4085-bc91-9f750c620884 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122862 Feb 21 02:34:41.426824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 397/776] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:34:41.497919 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ed5d53fb-da5e-4e71-b1a5-2ea14e9bf02b tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:41.505166 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ed5d53fb-da5e-4e71-b1a5-2ea14e9bf02b tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.176012 Feb 21 02:34:41.505954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 380/777] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:41 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:41.945789 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e616bd06-f079-43b5-b79c-7ef4f1bf1b55 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:41.946500 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e616bd06-f079-43b5-b79c-7ef4f1bf1b55 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:41.952490 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e616bd06-f079-43b5-b79c-7ef4f1bf1b55 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.952955 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e616bd06-f079-43b5-b79c-7ef4f1bf1b55 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:41.953793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e616bd06-f079-43b5-b79c-7ef4f1bf1b55 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:41.954245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e616bd06-f079-43b5-b79c-7ef4f1bf1b55 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.090175 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e616bd06-f079-43b5-b79c-7ef4f1bf1b55 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:42.097509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e616bd06-f079-43b5-b79c-7ef4f1bf1b55 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.156915 Feb 21 02:34:42.098123 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 398/778] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:41 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:42.221752 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:42.222498 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:42.229402 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:42.230002 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.230841 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:42.231444 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.304136 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-77431c05-c94a-4ad7-b211-e6469eb52270 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:42.304825 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-77431c05-c94a-4ad7-b211-e6469eb52270 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:42.310719 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-77431c05-c94a-4ad7-b211-e6469eb52270 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:42.311243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-77431c05-c94a-4ad7-b211-e6469eb52270 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.312194 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-77431c05-c94a-4ad7-b211-e6469eb52270 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:42.312706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-77431c05-c94a-4ad7-b211-e6469eb52270 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.339927 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-77431c05-c94a-4ad7-b211-e6469eb52270 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:34:42.362828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:42.371026 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:42.372519 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:42.373701 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-247572da-0a10-4b9a-8ed1-ab0d042409d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1746 microversion: 2.20 time: 0.155597 Feb 21 02:34:42.374266 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 399/779] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:42 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:42.419538 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-77431c05-c94a-4ad7-b211-e6469eb52270 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "DELETE /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 204 len: 0 microversion: 2.1 time: 0.214194 Feb 21 02:34:42.420537 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 381/780] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:34:42 2022] DELETE /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:34:42.429607 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-58b39cde-3b42-4dbb-bd55-b100392dda30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:42.430393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-58b39cde-3b42-4dbb-bd55-b100392dda30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:42.437331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-58b39cde-3b42-4dbb-bd55-b100392dda30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:42.437846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-58b39cde-3b42-4dbb-bd55-b100392dda30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.438633 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-58b39cde-3b42-4dbb-bd55-b100392dda30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:42.439074 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-58b39cde-3b42-4dbb-bd55-b100392dda30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.524285 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-db75e96a-f23e-43c5-9c12-4ac1186d16d4 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:42.525077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-db75e96a-f23e-43c5-9c12-4ac1186d16d4 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:42.531147 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db75e96a-f23e-43c5-9c12-4ac1186d16d4 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:42.531598 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db75e96a-f23e-43c5-9c12-4ac1186d16d4 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.532387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db75e96a-f23e-43c5-9c12-4ac1186d16d4 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:42.532824 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-db75e96a-f23e-43c5-9c12-4ac1186d16d4 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:42.582033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-58b39cde-3b42-4dbb-bd55-b100392dda30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:42.590138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-58b39cde-3b42-4dbb-bd55-b100392dda30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1576 microversion: 2.1 time: 0.165559 Feb 21 02:34:42.590708 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 400/781] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:42 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:43.010409 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-db75e96a-f23e-43c5-9c12-4ac1186d16d4 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:43.017842 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-db75e96a-f23e-43c5-9c12-4ac1186d16d4 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.498652 Feb 21 02:34:43.018403 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 382/782] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:42 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:43.114489 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7945b71b-8c08-4c5a-a0c5-c5902e6d2ab6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:43.115811 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7945b71b-8c08-4c5a-a0c5-c5902e6d2ab6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:43.122683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7945b71b-8c08-4c5a-a0c5-c5902e6d2ab6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:43.123137 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7945b71b-8c08-4c5a-a0c5-c5902e6d2ab6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:43.123927 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7945b71b-8c08-4c5a-a0c5-c5902e6d2ab6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:43.124366 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7945b71b-8c08-4c5a-a0c5-c5902e6d2ab6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:43.254762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7945b71b-8c08-4c5a-a0c5-c5902e6d2ab6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:43.262012 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7945b71b-8c08-4c5a-a0c5-c5902e6d2ab6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.151137 Feb 21 02:34:43.262616 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 401/783] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:43 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:43.392109 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:43.392740 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:43.399103 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:43.399549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:43.400317 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:43.400757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:43.538975 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:43.546488 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:43.547954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:43.549081 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7c869f3b-0fe3-4a43-be32-e0fd3dbe79ab tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1746 microversion: 2.20 time: 0.160704 Feb 21 02:34:43.549632 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 383/784] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:43 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:43.607387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-eff3163a-b734-4251-a3a2-f5d95b4a22c7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:43.607987 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-eff3163a-b734-4251-a3a2-f5d95b4a22c7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:43.614285 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-eff3163a-b734-4251-a3a2-f5d95b4a22c7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:43.614731 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-eff3163a-b734-4251-a3a2-f5d95b4a22c7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:43.615501 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-eff3163a-b734-4251-a3a2-f5d95b4a22c7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:43.615932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-eff3163a-b734-4251-a3a2-f5d95b4a22c7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:43.751109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-eff3163a-b734-4251-a3a2-f5d95b4a22c7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:43.758381 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-eff3163a-b734-4251-a3a2-f5d95b4a22c7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1576 microversion: 2.1 time: 0.154695 Feb 21 02:34:43.758937 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 402/785] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:43 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:44.034171 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-28795157-ece4-499b-a080-0ebf81e7d6b5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:44.034719 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-28795157-ece4-499b-a080-0ebf81e7d6b5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:44.040476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-28795157-ece4-499b-a080-0ebf81e7d6b5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:44.040932 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-28795157-ece4-499b-a080-0ebf81e7d6b5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:44.041713 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-28795157-ece4-499b-a080-0ebf81e7d6b5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:44.042144 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-28795157-ece4-499b-a080-0ebf81e7d6b5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:44.176539 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-28795157-ece4-499b-a080-0ebf81e7d6b5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:44.184617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-28795157-ece4-499b-a080-0ebf81e7d6b5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.154178 Feb 21 02:34:44.185187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 384/786] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:44 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:44.278483 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d4e4a8dc-e349-490b-9ffb-6d6bc4bb286e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:44.279214 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d4e4a8dc-e349-490b-9ffb-6d6bc4bb286e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:44.285434 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d4e4a8dc-e349-490b-9ffb-6d6bc4bb286e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:44.285859 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d4e4a8dc-e349-490b-9ffb-6d6bc4bb286e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:44.286649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d4e4a8dc-e349-490b-9ffb-6d6bc4bb286e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:44.287844 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d4e4a8dc-e349-490b-9ffb-6d6bc4bb286e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:44.419943 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d4e4a8dc-e349-490b-9ffb-6d6bc4bb286e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:44.426990 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d4e4a8dc-e349-490b-9ffb-6d6bc4bb286e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.152187 Feb 21 02:34:44.427552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 403/787] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:44 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:44.567283 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:44.567809 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:44.574176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:44.574614 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:44.575387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:44.575812 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:44.775274 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ee1d3959-edc2-4964-97cf-a5646661bb9e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:44.776004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ee1d3959-edc2-4964-97cf-a5646661bb9e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:44.781828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ee1d3959-edc2-4964-97cf-a5646661bb9e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:44.782261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ee1d3959-edc2-4964-97cf-a5646661bb9e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:44.783035 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ee1d3959-edc2-4964-97cf-a5646661bb9e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:44.783466 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ee1d3959-edc2-4964-97cf-a5646661bb9e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:44.783740 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:44.793886 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:44.795465 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:44.796713 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-73142ec3-23c9-44f5-bb28-5e3b149095a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1746 microversion: 2.20 time: 0.233130 Feb 21 02:34:44.797546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 385/788] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:44 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:44.923651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ee1d3959-edc2-4964-97cf-a5646661bb9e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:44.931350 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ee1d3959-edc2-4964-97cf-a5646661bb9e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1576 microversion: 2.1 time: 0.160447 Feb 21 02:34:44.931930 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 404/789] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:44 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:45.171749 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-ba07b934-c4dc-4c88-b53d-31925ca666e2 req-34ef571c-9c63-4c59-9fc3-fc685ade7f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba884d36-ccad-4dd6-8135-6f7bfc55077c", "name": "network-vif-plugged", "status": "completed", "tag": "ae827098-b4d8-4d85-b652-12a13456ab7e"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:45.173390 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:34:45.173390 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:34:45.181203 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-ba07b934-c4dc-4c88-b53d-31925ca666e2 req-34ef571c-9c63-4c59-9fc3-fc685ade7f84 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.181808 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-ba07b934-c4dc-4c88-b53d-31925ca666e2 req-34ef571c-9c63-4c59-9fc3-fc685ade7f84 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.194052 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-ba07b934-c4dc-4c88-b53d-31925ca666e2 req-34ef571c-9c63-4c59-9fc3-fc685ade7f84 service nova] Creating event network-vif-plugged:ae827098-b4d8-4d85-b652-12a13456ab7e for instance ba884d36-ccad-4dd6-8135-6f7bfc55077c on hv-cinder-80447 Feb 21 02:34:45.199653 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-ba07b934-c4dc-4c88-b53d-31925ca666e2 req-34ef571c-9c63-4c59-9fc3-fc685ade7f84 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Feb 21 02:34:45.200249 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 386/790] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:34:45.201520 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b60bd7bc-d3c0-4118-ab9c-81df52635bff tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:45.202189 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b60bd7bc-d3c0-4118-ab9c-81df52635bff tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:45.208990 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b60bd7bc-d3c0-4118-ab9c-81df52635bff tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.209575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b60bd7bc-d3c0-4118-ab9c-81df52635bff tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.210510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b60bd7bc-d3c0-4118-ab9c-81df52635bff tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.210956 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b60bd7bc-d3c0-4118-ab9c-81df52635bff tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.374079 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b60bd7bc-d3c0-4118-ab9c-81df52635bff tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:45.383271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b60bd7bc-d3c0-4118-ab9c-81df52635bff tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.186080 Feb 21 02:34:45.384722 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 405/791] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:45 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:45.445328 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f3a57bb4-b3da-4e46-bb2b-e650d67bb696 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:45.446078 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f3a57bb4-b3da-4e46-bb2b-e650d67bb696 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:45.460628 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f3a57bb4-b3da-4e46-bb2b-e650d67bb696 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.461081 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f3a57bb4-b3da-4e46-bb2b-e650d67bb696 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.461904 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f3a57bb4-b3da-4e46-bb2b-e650d67bb696 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.462338 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f3a57bb4-b3da-4e46-bb2b-e650d67bb696 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.757931 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-223c71b8-110c-4c5a-84db-9d7c62489dab req-0514c7f6-03e2-4030-ae0f-c8296e1d45fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e88ba1-3efc-43bb-a9fe-cea1161d320e", "name": "network-vif-deleted", "tag": "a0143c80-ec51-407d-bae9-5a6f62cc1615"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:45.759524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:34:45.759524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:34:45.766683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-223c71b8-110c-4c5a-84db-9d7c62489dab req-0514c7f6-03e2-4030-ae0f-c8296e1d45fd service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.767142 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-223c71b8-110c-4c5a-84db-9d7c62489dab req-0514c7f6-03e2-4030-ae0f-c8296e1d45fd service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.788993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-223c71b8-110c-4c5a-84db-9d7c62489dab req-0514c7f6-03e2-4030-ae0f-c8296e1d45fd service nova] Creating event network-vif-deleted:a0143c80-ec51-407d-bae9-5a6f62cc1615 for instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e on hv-cinder-80447 Feb 21 02:34:45.790710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f3a57bb4-b3da-4e46-bb2b-e650d67bb696 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:45.795004 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-223c71b8-110c-4c5a-84db-9d7c62489dab req-0514c7f6-03e2-4030-ae0f-c8296e1d45fd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040746 Feb 21 02:34:45.795821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 406/792] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:34:45.800654 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f3a57bb4-b3da-4e46-bb2b-e650d67bb696 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.360074 Feb 21 02:34:45.811331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 387/793] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:45 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:45.816600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:45.817476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:45.824227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.824678 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.826331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.827240 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.951705 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-75622307-b98c-439b-a2fc-9aa64ba939bd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:45.952622 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-75622307-b98c-439b-a2fc-9aa64ba939bd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:45.967291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-75622307-b98c-439b-a2fc-9aa64ba939bd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.967737 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-75622307-b98c-439b-a2fc-9aa64ba939bd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:45.968523 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-75622307-b98c-439b-a2fc-9aa64ba939bd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:45.969137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-75622307-b98c-439b-a2fc-9aa64ba939bd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:46.048849 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:46.057664 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:46.060771 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:46.062199 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-60f13089-0aa8-47aa-91ee-bb90c1d9640a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.249813 Feb 21 02:34:46.063320 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 407/794] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:45 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:46.124905 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-75622307-b98c-439b-a2fc-9aa64ba939bd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:46.135127 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-75622307-b98c-439b-a2fc-9aa64ba939bd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 200 len: 1508 microversion: 2.1 time: 0.188021 Feb 21 02:34:46.144518 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 388/795] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:45 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:46.400893 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-be1ee68a-8c6c-40bd-9f58-139144f861cd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:46.401464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-be1ee68a-8c6c-40bd-9f58-139144f861cd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:46.407940 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-be1ee68a-8c6c-40bd-9f58-139144f861cd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:46.408665 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-be1ee68a-8c6c-40bd-9f58-139144f861cd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:46.409460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-be1ee68a-8c6c-40bd-9f58-139144f861cd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:46.410415 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-be1ee68a-8c6c-40bd-9f58-139144f861cd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:46.653552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-be1ee68a-8c6c-40bd-9f58-139144f861cd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:46.664230 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-be1ee68a-8c6c-40bd-9f58-139144f861cd tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.267825 Feb 21 02:34:46.666249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 408/796] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:46 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:46.822066 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f8d9c53f-a3fe-4867-80c0-b55ec5bee65a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:46.824013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f8d9c53f-a3fe-4867-80c0-b55ec5bee65a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:46.835670 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f8d9c53f-a3fe-4867-80c0-b55ec5bee65a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:46.836400 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f8d9c53f-a3fe-4867-80c0-b55ec5bee65a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:46.837372 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f8d9c53f-a3fe-4867-80c0-b55ec5bee65a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:46.837993 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f8d9c53f-a3fe-4867-80c0-b55ec5bee65a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:47.054983 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f8d9c53f-a3fe-4867-80c0-b55ec5bee65a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:47.068623 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f8d9c53f-a3fe-4867-80c0-b55ec5bee65a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1358 microversion: 2.1 time: 0.254267 Feb 21 02:34:47.070710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 389/797] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:46 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:47.081075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:47.082024 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:47.090311 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:47.091725 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:47.093579 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:47.094271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:47.165796 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:47.166679 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:47.173607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:47.180800 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:47.181950 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:47.187864 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:47.223367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] HTTP exception thrown: Instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e could not be found. Feb 21 02:34:47.224622 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Returning 404 to user: Instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:34:47.226252 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ac3a3604-d1d5-4385-a075-dc13abb523a1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 404 len: 111 microversion: 2.1 time: 0.074563 Feb 21 02:34:47.227080 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 390/798] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:47 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 02:34:47.293204 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1042704216", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-72472954", "security_groups": [{"name": "tempest-secgroup-smoke-1444044047"}], "block_device_mapping_v2": [{"uuid": "88ff14b4-d829-4ab6-9eb8-08a5e6672ddf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c5e55e19-0047-4adf-9d84-20427890cdd2"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:47.373356 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:47.382854 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:47.384836 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:47.386093 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ab8ab4c7-7cf1-4414-b819-a5bb24e34c33 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.309048 Feb 21 02:34:47.398226 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 409/799] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:47 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:47.459012 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] validate_networks() for [('c5e55e19-0047-4adf-9d84-20427890cdd2', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:34:47.690990 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-92615d39-e347-490e-aea3-4df1ecdff753 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:47.691559 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-92615d39-e347-490e-aea3-4df1ecdff753 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:47.699317 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92615d39-e347-490e-aea3-4df1ecdff753 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:47.702425 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92615d39-e347-490e-aea3-4df1ecdff753 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:47.703523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92615d39-e347-490e-aea3-4df1ecdff753 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:47.704167 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-92615d39-e347-490e-aea3-4df1ecdff753 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:47.894524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-92615d39-e347-490e-aea3-4df1ecdff753 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:47.905599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-92615d39-e347-490e-aea3-4df1ecdff753 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.218144 Feb 21 02:34:47.918199 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 410/800] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:47 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:47.967939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:34:47.968965 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:34:47.970079 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:34:47.970722 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:34:47.971516 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:34:47.983517 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:47.984082 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:47.985256 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:47.985854 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.005945 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for project 9d0c19115c1746f1956552777cc35baf. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:34:48.010766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for user 9e81057507d24a2ca8f7b57eef422397 and project 9d0c19115c1746f1956552777cc35baf. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:34:48.074564 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:34:48.077418 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88ff14b4-d829-4ab6-9eb8-08a5e6672ddf',volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:34:48.091161 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7fd2174a-04f1-47d5-a746-c26840bb8718 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:48.091301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7fd2174a-04f1-47d5-a746-c26840bb8718 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:48.100110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7fd2174a-04f1-47d5-a746-c26840bb8718 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.100610 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7fd2174a-04f1-47d5-a746-c26840bb8718 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.101527 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7fd2174a-04f1-47d5-a746-c26840bb8718 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.102095 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7fd2174a-04f1-47d5-a746-c26840bb8718 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.269111 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7fd2174a-04f1-47d5-a746-c26840bb8718 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:48.278420 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7fd2174a-04f1-47d5-a746-c26840bb8718 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1549 microversion: 2.1 time: 0.191804 Feb 21 02:34:48.279590 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 411/801] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:48 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:48.294731 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-03dbaa1d-d256-4e34-aa75-fce29afc9374 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.009043 Feb 21 02:34:48.296292 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 391/802] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:34:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 02:34:48.310954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-756182e0-a99f-450f-ac9e-b11a2fb66bf1 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:48.311568 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-756182e0-a99f-450f-ac9e-b11a2fb66bf1 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:48.319874 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1f48057b-fba4-44c0-81ca-75b1522b7e2d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:48.320489 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1f48057b-fba4-44c0-81ca-75b1522b7e2d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:48.325521 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-756182e0-a99f-450f-ac9e-b11a2fb66bf1 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.327711 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-756182e0-a99f-450f-ac9e-b11a2fb66bf1 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.328762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-756182e0-a99f-450f-ac9e-b11a2fb66bf1 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.331142 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-756182e0-a99f-450f-ac9e-b11a2fb66bf1 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.435699 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1f48057b-fba4-44c0-81ca-75b1522b7e2d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:48.443532 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1f48057b-fba4-44c0-81ca-75b1522b7e2d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1093 microversion: 2.1 time: 0.128675 Feb 21 02:34:48.446627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 392/803] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:48 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1093 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:48.456117 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:48.460398 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:48.472102 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.475701 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.476703 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.477875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.573770 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-756182e0-a99f-450f-ac9e-b11a2fb66bf1 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:48.584046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-756182e0-a99f-450f-ac9e-b11a2fb66bf1 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1549 microversion: 2.1 time: 0.276234 Feb 21 02:34:48.595183 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 412/804] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:48 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1549 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:48.600037 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:48.603907 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:34:48.603907 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:34:48.605686 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:48.606625 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Searching by: {'deleted': False, 'project_id': 'e36f98f3ada743f7be39257e917a12c9'} {{(pid=116711) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 21 02:34:48.622032 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.622624 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.624671 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.625380 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.775418 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:48.792681 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:48.795212 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:48.797137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-455681e9-5cc1-4682-ba40-fffea965813c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.349104 Feb 21 02:34:48.798398 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 393/805] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:48 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:48.923635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-21489763-6849-4deb-b917-43d7f5dd7c30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:48.924296 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-21489763-6849-4deb-b917-43d7f5dd7c30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:48.942306 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-21489763-6849-4deb-b917-43d7f5dd7c30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.943041 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-21489763-6849-4deb-b917-43d7f5dd7c30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:48.943938 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-21489763-6849-4deb-b917-43d7f5dd7c30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:48.944560 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-21489763-6849-4deb-b917-43d7f5dd7c30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:49.038370 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.multi_cell_list [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116711) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 21 02:34:49.173818 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7c29ff27-6497-4b80-88a3-26110244053e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.577198 Feb 21 02:34:49.174618 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 413/806] 10.222.0.75 () {58 vars in 1124 bytes} [Mon Feb 21 02:34:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:34:49.186838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c76e27f0-e98e-43d0-89d1-f6cefda9199f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:49.187613 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c76e27f0-e98e-43d0-89d1-f6cefda9199f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:49.195386 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c76e27f0-e98e-43d0-89d1-f6cefda9199f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:49.195847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c76e27f0-e98e-43d0-89d1-f6cefda9199f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:49.196655 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c76e27f0-e98e-43d0-89d1-f6cefda9199f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:49.197097 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c76e27f0-e98e-43d0-89d1-f6cefda9199f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:49.203751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-21489763-6849-4deb-b917-43d7f5dd7c30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:49.215886 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-21489763-6849-4deb-b917-43d7f5dd7c30 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.296197 Feb 21 02:34:49.229810 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 394/807] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:48 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:49.429895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c76e27f0-e98e-43d0-89d1-f6cefda9199f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:49.442041 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c76e27f0-e98e-43d0-89d1-f6cefda9199f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1549 microversion: 2.1 time: 0.259525 Feb 21 02:34:49.444261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 414/808] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:49 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1549 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:49.464209 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a718cb60-7a60-4a41-aef6-e783b684c76b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:49.464725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a718cb60-7a60-4a41-aef6-e783b684c76b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:49.475696 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a718cb60-7a60-4a41-aef6-e783b684c76b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:49.476149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a718cb60-7a60-4a41-aef6-e783b684c76b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:49.476955 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a718cb60-7a60-4a41-aef6-e783b684c76b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:49.477425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a718cb60-7a60-4a41-aef6-e783b684c76b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:49.570114 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a718cb60-7a60-4a41-aef6-e783b684c76b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:49.582004 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a718cb60-7a60-4a41-aef6-e783b684c76b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1191 microversion: 2.1 time: 0.121324 Feb 21 02:34:49.587501 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 395/809] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:49 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1191 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:49.822983 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:49.825561 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:49.847208 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:49.848957 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:49.852555 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:49.853127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:50.171030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:50.181087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:50.183871 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:50.185258 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8072a84f-d25e-40ce-baf1-71c993203d18 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.373151 Feb 21 02:34:50.199048 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 415/810] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:49 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:50.241604 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5234db20-03ed-41c6-8665-61b59b9b43a0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:50.242927 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5234db20-03ed-41c6-8665-61b59b9b43a0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:50.251070 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5234db20-03ed-41c6-8665-61b59b9b43a0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:50.251773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5234db20-03ed-41c6-8665-61b59b9b43a0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:50.252734 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5234db20-03ed-41c6-8665-61b59b9b43a0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:50.253324 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5234db20-03ed-41c6-8665-61b59b9b43a0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:50.558288 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5234db20-03ed-41c6-8665-61b59b9b43a0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:50.568987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5234db20-03ed-41c6-8665-61b59b9b43a0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.333465 Feb 21 02:34:50.569965 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 396/811] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:50 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:50.601601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-52825d67-d5cb-45d5-936b-d1bd1b9d613e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:50.602245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-52825d67-d5cb-45d5-936b-d1bd1b9d613e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:50.608638 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-52825d67-d5cb-45d5-936b-d1bd1b9d613e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:50.609319 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-52825d67-d5cb-45d5-936b-d1bd1b9d613e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:50.610656 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-52825d67-d5cb-45d5-936b-d1bd1b9d613e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:50.611254 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-52825d67-d5cb-45d5-936b-d1bd1b9d613e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:50.703902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-52825d67-d5cb-45d5-936b-d1bd1b9d613e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:50.716524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-52825d67-d5cb-45d5-936b-d1bd1b9d613e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1209 microversion: 2.1 time: 0.119542 Feb 21 02:34:50.718141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 416/812] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:50 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:51.210558 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:51.211793 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:51.220523 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:51.220976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:51.222043 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:51.222257 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:51.351827 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-57f32b2a-b92f-4221-832d-29be68847058 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d235de4f-be2b-4d67-a160-7bcbc5319bfc"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:51.358105 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-57f32b2a-b92f-4221-832d-29be68847058 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:51.368297 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-57f32b2a-b92f-4221-832d-29be68847058 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:51.370899 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-57f32b2a-b92f-4221-832d-29be68847058 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:51.374480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-57f32b2a-b92f-4221-832d-29be68847058 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:51.375181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-57f32b2a-b92f-4221-832d-29be68847058 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:51.542083 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:51.569103 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:51.581236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:51.582679 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bac86468-389f-44f0-bbef-f4e7c8741ebc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.378172 Feb 21 02:34:51.591697 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 397/813] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:51 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:51.607708 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9d1f43f2-b7f8-477a-aaf7-edaf274068d1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:51.609930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9d1f43f2-b7f8-477a-aaf7-edaf274068d1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:51.623734 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9d1f43f2-b7f8-477a-aaf7-edaf274068d1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:51.624187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9d1f43f2-b7f8-477a-aaf7-edaf274068d1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:51.624996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9d1f43f2-b7f8-477a-aaf7-edaf274068d1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:51.629032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9d1f43f2-b7f8-477a-aaf7-edaf274068d1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:51.737013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-57f32b2a-b92f-4221-832d-29be68847058 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "POST /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389848 Feb 21 02:34:51.742753 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 417/814] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:34:51 2022] POST /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:34:51.742967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-84496056-c1cc-4b1d-b978-d20790409a6e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:51.743617 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-84496056-c1cc-4b1d-b978-d20790409a6e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:51.767370 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-84496056-c1cc-4b1d-b978-d20790409a6e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:51.768635 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-84496056-c1cc-4b1d-b978-d20790409a6e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:51.769625 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-84496056-c1cc-4b1d-b978-d20790409a6e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:51.770609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-84496056-c1cc-4b1d-b978-d20790409a6e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:51.978642 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-84496056-c1cc-4b1d-b978-d20790409a6e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:51.997176 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-84496056-c1cc-4b1d-b978-d20790409a6e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.257976 Feb 21 02:34:52.017634 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 418/815] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:51 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:52.070631 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9d1f43f2-b7f8-477a-aaf7-edaf274068d1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:52.078786 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9d1f43f2-b7f8-477a-aaf7-edaf274068d1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.485837 Feb 21 02:34:52.079364 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 398/816] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:51 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:52.495360 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-2d3f7962-fc6c-46a6-befb-2eec0a7f37ab req-4815a411-68cf-4e2e-9ae4-0581bf0b59bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44f197d-6813-4c77-8283-ce1b523de6cd", "tag": "b9cfa993-4c52-40b7-9623-8c41c63c23f3"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:34:52.496880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:34:52.496880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:34:52.511528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-2d3f7962-fc6c-46a6-befb-2eec0a7f37ab req-4815a411-68cf-4e2e-9ae4-0581bf0b59bc service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:52.512032 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-2d3f7962-fc6c-46a6-befb-2eec0a7f37ab req-4815a411-68cf-4e2e-9ae4-0581bf0b59bc service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:52.532008 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-2d3f7962-fc6c-46a6-befb-2eec0a7f37ab req-4815a411-68cf-4e2e-9ae4-0581bf0b59bc service nova] Creating event network-changed:b9cfa993-4c52-40b7-9623-8c41c63c23f3 for instance f44f197d-6813-4c77-8283-ce1b523de6cd on hv-cinder-80447 Feb 21 02:34:52.541480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-2d3f7962-fc6c-46a6-befb-2eec0a7f37ab req-4815a411-68cf-4e2e-9ae4-0581bf0b59bc service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049775 Feb 21 02:34:52.544263 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 419/817] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:34:52.610364 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:52.611630 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:52.625801 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:52.626395 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:52.627316 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:52.627834 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:52.869480 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:52.887961 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:52.889532 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:52.890831 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d3d270ed-b7c8-42f3-b24b-12fe567fd26b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.284677 Feb 21 02:34:52.891573 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 399/818] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:52 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:53.023461 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4a5ba528-41e4-4d26-a4d4-57b6bf00e5fa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:53.026544 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4a5ba528-41e4-4d26-a4d4-57b6bf00e5fa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:53.036067 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4a5ba528-41e4-4d26-a4d4-57b6bf00e5fa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:53.036724 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4a5ba528-41e4-4d26-a4d4-57b6bf00e5fa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:53.040203 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4a5ba528-41e4-4d26-a4d4-57b6bf00e5fa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:53.041993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4a5ba528-41e4-4d26-a4d4-57b6bf00e5fa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:53.100833 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-dc5107fd-2a75-4521-a0ce-bf1082e28d86 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:53.101450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-dc5107fd-2a75-4521-a0ce-bf1082e28d86 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:53.113533 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dc5107fd-2a75-4521-a0ce-bf1082e28d86 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:53.114016 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dc5107fd-2a75-4521-a0ce-bf1082e28d86 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:53.116719 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dc5107fd-2a75-4521-a0ce-bf1082e28d86 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:53.118871 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dc5107fd-2a75-4521-a0ce-bf1082e28d86 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:53.259284 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4a5ba528-41e4-4d26-a4d4-57b6bf00e5fa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:53.267207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4a5ba528-41e4-4d26-a4d4-57b6bf00e5fa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.254879 Feb 21 02:34:53.278089 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 420/819] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:53 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:53.342096 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-dc5107fd-2a75-4521-a0ce-bf1082e28d86 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:53.350246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-dc5107fd-2a75-4521-a0ce-bf1082e28d86 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.254579 Feb 21 02:34:53.351362 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 400/820] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:53 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:53.910795 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:53.912013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:53.924646 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:53.926105 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:53.928747 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:53.931668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:54.128151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:54.137313 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:54.138832 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:54.140018 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7fc805c3-fd6f-4812-b134-12d988f9722c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.233097 Feb 21 02:34:54.140583 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 421/821] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:53 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:54.285146 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b4b39840-c288-42d7-aebe-7d5f04d8da2c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:54.286527 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b4b39840-c288-42d7-aebe-7d5f04d8da2c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:54.293320 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b4b39840-c288-42d7-aebe-7d5f04d8da2c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:54.293730 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b4b39840-c288-42d7-aebe-7d5f04d8da2c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:54.294602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b4b39840-c288-42d7-aebe-7d5f04d8da2c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:54.295394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b4b39840-c288-42d7-aebe-7d5f04d8da2c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:54.373452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9dcb804f-e0a4-4aa4-ad6b-640a39c2a63e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:54.374180 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9dcb804f-e0a4-4aa4-ad6b-640a39c2a63e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:54.381236 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9dcb804f-e0a4-4aa4-ad6b-640a39c2a63e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:54.382020 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9dcb804f-e0a4-4aa4-ad6b-640a39c2a63e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:54.383016 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9dcb804f-e0a4-4aa4-ad6b-640a39c2a63e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:54.383509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9dcb804f-e0a4-4aa4-ad6b-640a39c2a63e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:54.497148 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b4b39840-c288-42d7-aebe-7d5f04d8da2c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:54.504722 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b4b39840-c288-42d7-aebe-7d5f04d8da2c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.223097 Feb 21 02:34:54.505883 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 401/822] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:54 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:54.552884 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9dcb804f-e0a4-4aa4-ad6b-640a39c2a63e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:54.563798 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9dcb804f-e0a4-4aa4-ad6b-640a39c2a63e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.194250 Feb 21 02:34:54.564381 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 422/823] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:54 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:55.157764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:55.158628 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:55.165753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:55.166242 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:55.167131 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:55.167635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:55.323367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:55.331829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:55.334198 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:55.335766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c899bd86-ae01-4fff-9184-33277d38c70c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.181617 Feb 21 02:34:55.345823 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 402/824] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:55 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:55.523630 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d527a460-eb0b-4240-b7a3-46184aa5a7f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:55.526051 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d527a460-eb0b-4240-b7a3-46184aa5a7f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:55.534186 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d527a460-eb0b-4240-b7a3-46184aa5a7f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:55.534869 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d527a460-eb0b-4240-b7a3-46184aa5a7f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:55.535742 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d527a460-eb0b-4240-b7a3-46184aa5a7f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:55.536217 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d527a460-eb0b-4240-b7a3-46184aa5a7f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:55.581523 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c62c3113-12c3-4ec1-8091-9adf555d0e03 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:55.582255 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c62c3113-12c3-4ec1-8091-9adf555d0e03 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:55.588976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62c3113-12c3-4ec1-8091-9adf555d0e03 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:55.589549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62c3113-12c3-4ec1-8091-9adf555d0e03 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:55.590763 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62c3113-12c3-4ec1-8091-9adf555d0e03 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:55.591286 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62c3113-12c3-4ec1-8091-9adf555d0e03 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:55.736501 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d527a460-eb0b-4240-b7a3-46184aa5a7f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:55.745029 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d527a460-eb0b-4240-b7a3-46184aa5a7f1 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.225744 Feb 21 02:34:55.745614 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 423/825] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:55 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:55.783851 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c62c3113-12c3-4ec1-8091-9adf555d0e03 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:55.792916 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c62c3113-12c3-4ec1-8091-9adf555d0e03 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.215219 Feb 21 02:34:55.793957 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 403/826] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:55 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:34:56.356086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:56.357017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:56.369946 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:56.370495 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:56.371370 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:56.374751 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:56.543801 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:56.552185 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:56.554592 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:56.555873 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-55165181-beae-42be-9985-5b61dba8a46d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.203884 Feb 21 02:34:56.556718 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 424/827] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:56 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:34:56.762238 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a2478f29-6706-4082-9e30-83921002e51b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:56.762918 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a2478f29-6706-4082-9e30-83921002e51b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:56.769585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2478f29-6706-4082-9e30-83921002e51b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:56.770062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2478f29-6706-4082-9e30-83921002e51b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:56.771531 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2478f29-6706-4082-9e30-83921002e51b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:56.771968 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2478f29-6706-4082-9e30-83921002e51b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:56.813497 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a7aae9a6-e9c4-47d4-a920-676da2a92c17 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:56.813497 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a7aae9a6-e9c4-47d4-a920-676da2a92c17 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:56.820549 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a7aae9a6-e9c4-47d4-a920-676da2a92c17 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:56.821773 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a7aae9a6-e9c4-47d4-a920-676da2a92c17 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:56.821773 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a7aae9a6-e9c4-47d4-a920-676da2a92c17 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:56.822409 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a7aae9a6-e9c4-47d4-a920-676da2a92c17 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:56.998663 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a7aae9a6-e9c4-47d4-a920-676da2a92c17 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:57.010684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a7aae9a6-e9c4-47d4-a920-676da2a92c17 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.201247 Feb 21 02:34:57.015542 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a2478f29-6706-4082-9e30-83921002e51b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:57.021830 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 425/828] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:56 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:57.023443 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a2478f29-6706-4082-9e30-83921002e51b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.264805 Feb 21 02:34:57.032473 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 404/829] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:56 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:57.575286 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:57.576099 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:57.582282 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:57.582830 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:57.583665 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:57.584111 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:57.725992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:57.733582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:57.735350 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:57.736489 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dbac674b-39a2-4394-abca-a0567b915a3d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1741 microversion: 2.20 time: 0.165048 Feb 21 02:34:57.737034 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 426/830] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:57 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:58.031080 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c31ec26e-7f25-4bb3-8683-57d6347fb9b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:58.031680 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c31ec26e-7f25-4bb3-8683-57d6347fb9b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:58.038233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c31ec26e-7f25-4bb3-8683-57d6347fb9b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:58.038691 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c31ec26e-7f25-4bb3-8683-57d6347fb9b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:58.039470 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c31ec26e-7f25-4bb3-8683-57d6347fb9b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:58.039821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c6d3b16b-b62e-4632-acba-1ac710669942 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:58.039939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c31ec26e-7f25-4bb3-8683-57d6347fb9b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:58.040437 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c6d3b16b-b62e-4632-acba-1ac710669942 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:58.046249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c6d3b16b-b62e-4632-acba-1ac710669942 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:58.046699 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c6d3b16b-b62e-4632-acba-1ac710669942 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:58.047475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c6d3b16b-b62e-4632-acba-1ac710669942 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:58.047913 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c6d3b16b-b62e-4632-acba-1ac710669942 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:58.180889 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c31ec26e-7f25-4bb3-8683-57d6347fb9b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:58.181347 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c6d3b16b-b62e-4632-acba-1ac710669942 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:58.188846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c6d3b16b-b62e-4632-acba-1ac710669942 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.152780 Feb 21 02:34:58.189188 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c31ec26e-7f25-4bb3-8683-57d6347fb9b3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.161664 Feb 21 02:34:58.189421 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 427/831] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:58 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:58.190410 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 405/832] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:58 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:58.754823 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:58.755582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:58.761988 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:58.762447 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:58.763237 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:58.763730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:58.901273 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:58.909117 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:58.910665 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:58.911916 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-819e0dab-bcae-468b-9a28-805d86534dd2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1723 microversion: 2.20 time: 0.160793 Feb 21 02:34:58.912475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 428/833] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:58 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:34:59.206046 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a188f291-2568-421c-ac4e-ba86acdd96f5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:59.206628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9fcd1bf1-0ba0-4eb8-94f7-219663b203c5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:59.206831 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a188f291-2568-421c-ac4e-ba86acdd96f5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:59.207237 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9fcd1bf1-0ba0-4eb8-94f7-219663b203c5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:59.213794 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9fcd1bf1-0ba0-4eb8-94f7-219663b203c5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:59.214245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9fcd1bf1-0ba0-4eb8-94f7-219663b203c5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:59.214371 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a188f291-2568-421c-ac4e-ba86acdd96f5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:59.214765 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a188f291-2568-421c-ac4e-ba86acdd96f5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:59.215029 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9fcd1bf1-0ba0-4eb8-94f7-219663b203c5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:59.215462 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9fcd1bf1-0ba0-4eb8-94f7-219663b203c5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:59.215570 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a188f291-2568-421c-ac4e-ba86acdd96f5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:59.216005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a188f291-2568-421c-ac4e-ba86acdd96f5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:59.379036 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a188f291-2568-421c-ac4e-ba86acdd96f5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:59.387856 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a188f291-2568-421c-ac4e-ba86acdd96f5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.185477 Feb 21 02:34:59.390896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 406/834] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:59 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:59.399044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9fcd1bf1-0ba0-4eb8-94f7-219663b203c5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:59.407470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9fcd1bf1-0ba0-4eb8-94f7-219663b203c5 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.204344 Feb 21 02:34:59.408129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 429/835] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:59 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:59.422378 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9b8b517d-2997-4fc0-b53b-81f4d653da1e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:59.422981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9b8b517d-2997-4fc0-b53b-81f4d653da1e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:59.429128 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b8b517d-2997-4fc0-b53b-81f4d653da1e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:59.429574 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b8b517d-2997-4fc0-b53b-81f4d653da1e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:59.430420 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b8b517d-2997-4fc0-b53b-81f4d653da1e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:59.430847 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9b8b517d-2997-4fc0-b53b-81f4d653da1e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:59.567320 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9b8b517d-2997-4fc0-b53b-81f4d653da1e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:34:59.575061 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9b8b517d-2997-4fc0-b53b-81f4d653da1e tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1595 microversion: 2.1 time: 0.156322 Feb 21 02:34:59.575621 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 407/836] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:34:59 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:34:59.930933 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:34:59.931547 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:34:59.937493 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:59.938003 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:34:59.938791 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:34:59.939417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:00.076181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:00.084682 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:00.086495 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:00.087660 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e6d06549-382d-475e-bbd3-e6f35dd4eb77 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1723 microversion: 2.20 time: 0.161121 Feb 21 02:35:00.088473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 430/837] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:34:59 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:00.408205 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-acfac970-432f-48fe-8be6-167e0e2f1914 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:00.408841 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-acfac970-432f-48fe-8be6-167e0e2f1914 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:00.415235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-acfac970-432f-48fe-8be6-167e0e2f1914 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:00.415686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-acfac970-432f-48fe-8be6-167e0e2f1914 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:00.416470 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-acfac970-432f-48fe-8be6-167e0e2f1914 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:00.416905 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-acfac970-432f-48fe-8be6-167e0e2f1914 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:00.424243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-56cc6083-7479-4180-8099-19e8e6aab39a tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:00.424858 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-56cc6083-7479-4180-8099-19e8e6aab39a tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:00.432245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-56cc6083-7479-4180-8099-19e8e6aab39a tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:00.432698 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-56cc6083-7479-4180-8099-19e8e6aab39a tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:00.433485 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-56cc6083-7479-4180-8099-19e8e6aab39a tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:00.433950 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-56cc6083-7479-4180-8099-19e8e6aab39a tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:00.571927 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-56cc6083-7479-4180-8099-19e8e6aab39a tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:00.579349 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-56cc6083-7479-4180-8099-19e8e6aab39a tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1509 microversion: 2.1 time: 0.158718 Feb 21 02:35:00.580009 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 431/838] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:00 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:00.596405 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-68c3ab32-80cc-40bc-a887-b60e410b5588 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:00.597008 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-68c3ab32-80cc-40bc-a887-b60e410b5588 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:00.603323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-68c3ab32-80cc-40bc-a887-b60e410b5588 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:00.603770 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-68c3ab32-80cc-40bc-a887-b60e410b5588 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:00.604558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-68c3ab32-80cc-40bc-a887-b60e410b5588 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:00.604994 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-68c3ab32-80cc-40bc-a887-b60e410b5588 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:00.636721 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-acfac970-432f-48fe-8be6-167e0e2f1914 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:00.645052 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-acfac970-432f-48fe-8be6-167e0e2f1914 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.240440 Feb 21 02:35:00.646299 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 408/839] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:00 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:00.743819 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-68c3ab32-80cc-40bc-a887-b60e410b5588 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "POST /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba/action" status: 202 len: 0 microversion: 2.1 time: 0.150951 Feb 21 02:35:00.744706 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 432/840] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:35:00 2022] POST /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:35:00.753856 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-39e76057-65f7-495e-9924-540466ddf454 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:00.755648 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-39e76057-65f7-495e-9924-540466ddf454 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:00.762297 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39e76057-65f7-495e-9924-540466ddf454 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:00.763034 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39e76057-65f7-495e-9924-540466ddf454 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:00.764577 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39e76057-65f7-495e-9924-540466ddf454 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:00.765546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39e76057-65f7-495e-9924-540466ddf454 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.107971 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:01.109232 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:01.116248 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.116997 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.118151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.118810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.298906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:01.308938 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:01.311045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:01.312274 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8d191188-a4fd-4445-a4b9-6b7934d46b92 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1726 microversion: 2.20 time: 0.208452 Feb 21 02:35:01.321002 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-39e76057-65f7-495e-9924-540466ddf454 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:01.331349 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 433/841] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:01 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:35:01.337417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-78958b7f-fdd9-4914-8597-cc7fa93c73a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1da3a24a-7f99-4102-8d72-e1cbe3d31204"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:01.338775 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-78958b7f-fdd9-4914-8597-cc7fa93c73a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:01.341490 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-39e76057-65f7-495e-9924-540466ddf454 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1517 microversion: 2.1 time: 0.592523 Feb 21 02:35:01.345301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-78958b7f-fdd9-4914-8597-cc7fa93c73a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.346150 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-78958b7f-fdd9-4914-8597-cc7fa93c73a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.347700 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-78958b7f-fdd9-4914-8597-cc7fa93c73a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.348301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-78958b7f-fdd9-4914-8597-cc7fa93c73a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.360359 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 409/842] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:00 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1517 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:35:01.387315 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-29b4d1a8-4eb2-44b0-9f73-42d1e03511a1 req-42bd24b1-6d5b-491b-a127-0d6989756f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fd287f-356c-4485-ba82-bbe3da3cf5ba", "name": "network-vif-unplugged", "status": "completed", "tag": "212cff7d-b04b-4efb-be92-6dd1bd6ec779"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:01.389150 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:01.389150 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:35:01.404243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-29b4d1a8-4eb2-44b0-9f73-42d1e03511a1 req-42bd24b1-6d5b-491b-a127-0d6989756f57 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.405011 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-29b4d1a8-4eb2-44b0-9f73-42d1e03511a1 req-42bd24b1-6d5b-491b-a127-0d6989756f57 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.423487 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.compute.server_external_events [req-29b4d1a8-4eb2-44b0-9f73-42d1e03511a1 req-42bd24b1-6d5b-491b-a127-0d6989756f57 service nova] Unable to find a host for instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba. Dropping event network-vif-unplugged {{(pid=116710) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 21 02:35:01.425611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-29b4d1a8-4eb2-44b0-9f73-42d1e03511a1 req-42bd24b1-6d5b-491b-a127-0d6989756f57 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057381 Feb 21 02:35:01.426466 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 410/843] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 21 02:35:01.664065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1f9bd150-579c-490c-bca4-4cd0ea933cbc tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:01.664802 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1f9bd150-579c-490c-bca4-4cd0ea933cbc tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:01.673014 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f9bd150-579c-490c-bca4-4cd0ea933cbc tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.674147 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f9bd150-579c-490c-bca4-4cd0ea933cbc tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.675997 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f9bd150-579c-490c-bca4-4cd0ea933cbc tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.679859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f9bd150-579c-490c-bca4-4cd0ea933cbc tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.793976 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-78958b7f-fdd9-4914-8597-cc7fa93c73a7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.460702 Feb 21 02:35:01.796531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 434/844] 10.222.0.75 () {62 vars in 1363 bytes} [Mon Feb 21 02:35:01 2022] POST /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments => generated 188 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:35:01.920458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-1f9bd150-579c-490c-bca4-4cd0ea933cbc tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:01.921865 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2852fd73-be4f-4b0a-8bc5-2d45414c2efb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:01.922665 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2852fd73-be4f-4b0a-8bc5-2d45414c2efb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:01.929348 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1f9bd150-579c-490c-bca4-4cd0ea933cbc tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.270104 Feb 21 02:35:01.930216 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 411/845] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:01 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:01.930829 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2852fd73-be4f-4b0a-8bc5-2d45414c2efb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.931273 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2852fd73-be4f-4b0a-8bc5-2d45414c2efb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:01.932080 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2852fd73-be4f-4b0a-8bc5-2d45414c2efb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:01.932528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2852fd73-be4f-4b0a-8bc5-2d45414c2efb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:02.025929 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2852fd73-be4f-4b0a-8bc5-2d45414c2efb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/action" status: 202 len: 0 microversion: 2.20 time: 0.107554 Feb 21 02:35:02.036845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:02.037626 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:02.043830 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 435/846] 10.222.0.75 () {62 vars in 1318 bytes} [Mon Feb 21 02:35:01 2022] POST /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 21 02:35:02.047313 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:02.048669 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:02.049732 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:02.050376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:02.069809 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-d2ffbc09-9e7a-4bf4-a14f-7015b1746fd9 req-a0186fb7-7e24-4df9-b0b1-b348e26a5add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba884d36-ccad-4dd6-8135-6f7bfc55077c", "tag": "ae827098-b4d8-4d85-b652-12a13456ab7e"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:02.072044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:02.072044 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:35:02.082019 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-d2ffbc09-9e7a-4bf4-a14f-7015b1746fd9 req-a0186fb7-7e24-4df9-b0b1-b348e26a5add service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:02.082637 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-d2ffbc09-9e7a-4bf4-a14f-7015b1746fd9 req-a0186fb7-7e24-4df9-b0b1-b348e26a5add service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:02.096430 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-d2ffbc09-9e7a-4bf4-a14f-7015b1746fd9 req-a0186fb7-7e24-4df9-b0b1-b348e26a5add service nova] Creating event network-changed:ae827098-b4d8-4d85-b652-12a13456ab7e for instance ba884d36-ccad-4dd6-8135-6f7bfc55077c on hv-cinder-80447 Feb 21 02:35:02.102813 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-d2ffbc09-9e7a-4bf4-a14f-7015b1746fd9 req-a0186fb7-7e24-4df9-b0b1-b348e26a5add service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039954 Feb 21 02:35:02.112184 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 436/847] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:02.355784 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:02.361243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0ff8ac0a-6a0e-4aec-9572-70901a81f053 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:02.361847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0ff8ac0a-6a0e-4aec-9572-70901a81f053 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:02.367220 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:02.368967 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:02.370793 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-870a5919-22d8-4336-a1e2-2863f0ac44ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1752 microversion: 2.20 time: 0.339138 Feb 21 02:35:02.371279 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0ff8ac0a-6a0e-4aec-9572-70901a81f053 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:02.371772 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0ff8ac0a-6a0e-4aec-9572-70901a81f053 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:02.372452 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 412/848] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:02 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1752 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:02.390172 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0ff8ac0a-6a0e-4aec-9572-70901a81f053 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:02.390651 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0ff8ac0a-6a0e-4aec-9572-70901a81f053 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:02.653694 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0ff8ac0a-6a0e-4aec-9572-70901a81f053 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:02.669061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0ff8ac0a-6a0e-4aec-9572-70901a81f053 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1519 microversion: 2.1 time: 0.313383 Feb 21 02:35:02.669968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 437/849] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:02 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1519 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:02.946619 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8534fb4c-2b51-4c91-bc78-5b8d025df3b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:02.947375 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8534fb4c-2b51-4c91-bc78-5b8d025df3b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:02.959057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8534fb4c-2b51-4c91-bc78-5b8d025df3b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:02.959846 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8534fb4c-2b51-4c91-bc78-5b8d025df3b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:02.960890 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8534fb4c-2b51-4c91-bc78-5b8d025df3b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:02.961563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8534fb4c-2b51-4c91-bc78-5b8d025df3b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:03.293745 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8534fb4c-2b51-4c91-bc78-5b8d025df3b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:03.310139 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8534fb4c-2b51-4c91-bc78-5b8d025df3b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.367082 Feb 21 02:35:03.311810 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 413/850] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:02 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:03.390936 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:03.393900 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:03.403475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:03.404477 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:03.405338 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:03.405875 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:03.455142 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-b1d1797a-f1bc-437c-9955-22b83c90abea req-036f8a83-4f01-493f-a9d6-bd3a166bac09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8e707-e1a8-46b8-8b47-ef1d9ef77903", "name": "network-vif-unplugged", "status": "completed", "tag": "186e3f15-c158-44f9-a144-358d5ab62c8f"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:03.456794 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:03.456794 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:35:03.467062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-b1d1797a-f1bc-437c-9955-22b83c90abea req-036f8a83-4f01-493f-a9d6-bd3a166bac09 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:03.467794 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-b1d1797a-f1bc-437c-9955-22b83c90abea req-036f8a83-4f01-493f-a9d6-bd3a166bac09 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:03.490753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.compute.server_external_events [req-b1d1797a-f1bc-437c-9955-22b83c90abea req-036f8a83-4f01-493f-a9d6-bd3a166bac09 service nova] Unable to find a host for instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903. Dropping event network-vif-unplugged {{(pid=116710) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 21 02:35:03.492170 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-b1d1797a-f1bc-437c-9955-22b83c90abea req-036f8a83-4f01-493f-a9d6-bd3a166bac09 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040745 Feb 21 02:35:03.492777 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 414/851] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 21 02:35:03.607762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:03.617209 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:03.618948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:03.620401 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-501afcd9-3fba-4ce9-9a00-eb41ee57c875 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1754 microversion: 2.20 time: 0.233902 Feb 21 02:35:03.621071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 438/852] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:03 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1754 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:03.686906 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-387ce87e-bf38-4249-8836-39e76e56171c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:03.687776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-387ce87e-bf38-4249-8836-39e76e56171c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:03.695116 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-387ce87e-bf38-4249-8836-39e76e56171c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:03.695568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-387ce87e-bf38-4249-8836-39e76e56171c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:03.696554 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-387ce87e-bf38-4249-8836-39e76e56171c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:03.697158 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-387ce87e-bf38-4249-8836-39e76e56171c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:03.803320 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-746a51bd-04c6-497d-bb1b-b41ce607b695 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-867262286"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:03.804121 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-746a51bd-04c6-497d-bb1b-b41ce607b695 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:03.811847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-746a51bd-04c6-497d-bb1b-b41ce607b695 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:03.812254 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-746a51bd-04c6-497d-bb1b-b41ce607b695 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:03.813105 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-746a51bd-04c6-497d-bb1b-b41ce607b695 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:03.814009 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-746a51bd-04c6-497d-bb1b-b41ce607b695 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:03.965552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.network.security_group_api [None req-746a51bd-04c6-497d-bb1b-b41ce607b695 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Adding security group 6d986f78-46d0-4b70-8b8d-7cb5af1e43c6 to port ae827098-b4d8-4d85-b652-12a13456ab7e Feb 21 02:35:03.988650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-387ce87e-bf38-4249-8836-39e76e56171c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:03.998492 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-387ce87e-bf38-4249-8836-39e76e56171c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.314339 Feb 21 02:35:03.999694 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 415/853] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:03 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:04.327989 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5e0279fb-a92d-4ed6-beeb-c53f2d13af45 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:04.332506 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5e0279fb-a92d-4ed6-beeb-c53f2d13af45 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:04.338532 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5e0279fb-a92d-4ed6-beeb-c53f2d13af45 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:04.339076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5e0279fb-a92d-4ed6-beeb-c53f2d13af45 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:04.340076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5e0279fb-a92d-4ed6-beeb-c53f2d13af45 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:04.340585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5e0279fb-a92d-4ed6-beeb-c53f2d13af45 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:04.496783 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5e0279fb-a92d-4ed6-beeb-c53f2d13af45 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:04.504572 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5e0279fb-a92d-4ed6-beeb-c53f2d13af45 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.180311 Feb 21 02:35:04.505446 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 416/854] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:04 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:35:04.573895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-746a51bd-04c6-497d-bb1b-b41ce607b695 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "POST /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/action" status: 202 len: 0 microversion: 2.1 time: 0.776854 Feb 21 02:35:04.574872 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 439/855] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:35:03 2022] POST /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:35:04.599814 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0bd1698d-c585-42da-8caf-4fb33d6cd89a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:04.605563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0bd1698d-c585-42da-8caf-4fb33d6cd89a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:04.616552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0bd1698d-c585-42da-8caf-4fb33d6cd89a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:04.617089 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0bd1698d-c585-42da-8caf-4fb33d6cd89a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:04.618199 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0bd1698d-c585-42da-8caf-4fb33d6cd89a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:04.619307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0bd1698d-c585-42da-8caf-4fb33d6cd89a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:04.692833 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-6639bdad-2a37-40ef-abd8-735dea1df79a req-7d0b4bc8-1a40-4def-b21d-9eae65ed474b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba884d36-ccad-4dd6-8135-6f7bfc55077c", "tag": "ae827098-b4d8-4d85-b652-12a13456ab7e"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:04.694611 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:04.694611 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:35:04.701898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-6639bdad-2a37-40ef-abd8-735dea1df79a req-7d0b4bc8-1a40-4def-b21d-9eae65ed474b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:04.702700 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-6639bdad-2a37-40ef-abd8-735dea1df79a req-7d0b4bc8-1a40-4def-b21d-9eae65ed474b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:04.718099 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-6639bdad-2a37-40ef-abd8-735dea1df79a req-7d0b4bc8-1a40-4def-b21d-9eae65ed474b service nova] Creating event network-changed:ae827098-b4d8-4d85-b652-12a13456ab7e for instance ba884d36-ccad-4dd6-8135-6f7bfc55077c on hv-cinder-80447 Feb 21 02:35:04.723576 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-6639bdad-2a37-40ef-abd8-735dea1df79a req-7d0b4bc8-1a40-4def-b21d-9eae65ed474b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142991 Feb 21 02:35:04.725926 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 440/856] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:04.747831 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:04.750074 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:04.759582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:04.760432 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:04.762972 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:04.763727 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:04.927343 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:04.937288 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:04.939702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:04.941171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3cb1e3b1-8484-455d-be07-9882a750c79d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.213861 Feb 21 02:35:04.942148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 441/857] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:04 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:05.016723 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6576572a-95c3-4de9-91f8-f46c1309baa6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:05.017344 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6576572a-95c3-4de9-91f8-f46c1309baa6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:05.024240 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6576572a-95c3-4de9-91f8-f46c1309baa6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:05.024685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6576572a-95c3-4de9-91f8-f46c1309baa6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:05.025509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6576572a-95c3-4de9-91f8-f46c1309baa6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:05.026919 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6576572a-95c3-4de9-91f8-f46c1309baa6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:05.046940 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0bd1698d-c585-42da-8caf-4fb33d6cd89a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:05.060590 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0bd1698d-c585-42da-8caf-4fb33d6cd89a tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1760 microversion: 2.1 time: 0.480214 Feb 21 02:35:05.061490 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 417/858] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:04 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1760 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:05.194924 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6576572a-95c3-4de9-91f8-f46c1309baa6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:05.203764 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6576572a-95c3-4de9-91f8-f46c1309baa6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.190816 Feb 21 02:35:05.205164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 442/859] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:05 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:05.510237 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-45347323-91f6-4e40-be42-a962c202c41f req-c761685e-cd3a-41cf-a83a-efdc1dbdaf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f197d-6813-4c77-8283-ce1b523de6cd", "name": "network-vif-plugged", "status": "completed", "tag": "b9cfa993-4c52-40b7-9623-8c41c63c23f3"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:05.512422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:05.512422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:35:05.523087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a939bc66-be6a-43e9-9d07-e4c4ee187b42 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:05.523833 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a939bc66-be6a-43e9-9d07-e4c4ee187b42 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:05.526536 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-45347323-91f6-4e40-be42-a962c202c41f req-c761685e-cd3a-41cf-a83a-efdc1dbdaf67 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:05.527340 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-45347323-91f6-4e40-be42-a962c202c41f req-c761685e-cd3a-41cf-a83a-efdc1dbdaf67 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:05.530874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a939bc66-be6a-43e9-9d07-e4c4ee187b42 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:05.531400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a939bc66-be6a-43e9-9d07-e4c4ee187b42 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:05.532402 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a939bc66-be6a-43e9-9d07-e4c4ee187b42 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:05.533039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a939bc66-be6a-43e9-9d07-e4c4ee187b42 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:05.540778 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-45347323-91f6-4e40-be42-a962c202c41f req-c761685e-cd3a-41cf-a83a-efdc1dbdaf67 service nova] Creating event network-vif-plugged:b9cfa993-4c52-40b7-9623-8c41c63c23f3 for instance f44f197d-6813-4c77-8283-ce1b523de6cd on hv-cinder-80447 Feb 21 02:35:05.546009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-45347323-91f6-4e40-be42-a962c202c41f req-c761685e-cd3a-41cf-a83a-efdc1dbdaf67 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041611 Feb 21 02:35:05.546758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 418/860] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:05.671550 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a939bc66-be6a-43e9-9d07-e4c4ee187b42 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:05.680060 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a939bc66-be6a-43e9-9d07-e4c4ee187b42 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.161057 Feb 21 02:35:05.681105 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 443/861] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:05 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:05.961436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:05.962151 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:05.968140 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:05.968579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:05.969353 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:05.969825 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:06.140584 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:06.149387 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:06.150903 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:06.152065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-50b2245f-d725-4ed8-973c-5f2922102e91 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.196140 Feb 21 02:35:06.152622 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 419/862] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:05 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:06.219921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fbb3f7bf-5be9-4d67-bca8-87d8dacdd5ef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:06.220526 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fbb3f7bf-5be9-4d67-bca8-87d8dacdd5ef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:06.226898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fbb3f7bf-5be9-4d67-bca8-87d8dacdd5ef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:06.227341 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fbb3f7bf-5be9-4d67-bca8-87d8dacdd5ef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:06.228106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fbb3f7bf-5be9-4d67-bca8-87d8dacdd5ef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:06.228533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fbb3f7bf-5be9-4d67-bca8-87d8dacdd5ef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:06.368656 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fbb3f7bf-5be9-4d67-bca8-87d8dacdd5ef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:06.376456 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fbb3f7bf-5be9-4d67-bca8-87d8dacdd5ef tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.160084 Feb 21 02:35:06.377015 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 444/863] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:06 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:06.698733 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-027ba893-7166-40bb-ada7-a390313aadb9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:06.699770 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-027ba893-7166-40bb-ada7-a390313aadb9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:06.707121 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-027ba893-7166-40bb-ada7-a390313aadb9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:06.708490 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-027ba893-7166-40bb-ada7-a390313aadb9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:06.709899 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-027ba893-7166-40bb-ada7-a390313aadb9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:06.710978 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-027ba893-7166-40bb-ada7-a390313aadb9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:06.866044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-027ba893-7166-40bb-ada7-a390313aadb9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:06.873687 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-027ba893-7166-40bb-ada7-a390313aadb9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.178704 Feb 21 02:35:06.874466 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 420/864] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:06 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:07.170918 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:07.171522 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:07.179558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:07.180007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:07.180800 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:07.181235 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:07.328275 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:07.338205 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:07.339787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:07.341070 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-791cc135-d774-4bab-831a-0d8b4e8425a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.173863 Feb 21 02:35:07.341629 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 445/865] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:07 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:07.393942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-368af04c-762f-431b-adab-9adcc2bbdee1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:07.394557 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-368af04c-762f-431b-adab-9adcc2bbdee1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:07.401144 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-368af04c-762f-431b-adab-9adcc2bbdee1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:07.401600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-368af04c-762f-431b-adab-9adcc2bbdee1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:07.402484 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-368af04c-762f-431b-adab-9adcc2bbdee1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:07.402921 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-368af04c-762f-431b-adab-9adcc2bbdee1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:07.547439 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-368af04c-762f-431b-adab-9adcc2bbdee1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:07.555948 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-368af04c-762f-431b-adab-9adcc2bbdee1 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.165422 Feb 21 02:35:07.557124 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 421/866] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:07 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:07.891161 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-22cf2118-835e-4c15-a4e3-67616bc5e6fe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:07.891913 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-22cf2118-835e-4c15-a4e3-67616bc5e6fe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:07.898711 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-22cf2118-835e-4c15-a4e3-67616bc5e6fe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:07.899169 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-22cf2118-835e-4c15-a4e3-67616bc5e6fe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:07.899966 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-22cf2118-835e-4c15-a4e3-67616bc5e6fe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:07.900408 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-22cf2118-835e-4c15-a4e3-67616bc5e6fe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:08.050499 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-22cf2118-835e-4c15-a4e3-67616bc5e6fe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:08.059172 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-22cf2118-835e-4c15-a4e3-67616bc5e6fe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.171602 Feb 21 02:35:08.059760 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 446/867] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:07 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:08.359455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:08.360627 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:08.372813 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:08.373340 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:08.374226 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:08.374720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:08.514541 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:08.523198 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:08.524688 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:08.525877 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-17e970d8-95af-4602-ac15-b1111a5270f4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.170225 Feb 21 02:35:08.526434 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 422/868] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:08 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:08.573318 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-579b8317-9ee4-4aa8-8882-2267470ceb31 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:08.574109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-579b8317-9ee4-4aa8-8882-2267470ceb31 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:08.580319 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-579b8317-9ee4-4aa8-8882-2267470ceb31 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:08.580777 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-579b8317-9ee4-4aa8-8882-2267470ceb31 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:08.581572 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-579b8317-9ee4-4aa8-8882-2267470ceb31 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:08.582085 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-579b8317-9ee4-4aa8-8882-2267470ceb31 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:08.729255 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-579b8317-9ee4-4aa8-8882-2267470ceb31 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:08.737038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-579b8317-9ee4-4aa8-8882-2267470ceb31 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.167521 Feb 21 02:35:08.741854 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 447/869] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:08 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:09.076436 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a9726bcb-ccde-4e5c-aba8-4e7d90df72d5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:09.077074 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a9726bcb-ccde-4e5c-aba8-4e7d90df72d5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:09.083709 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a9726bcb-ccde-4e5c-aba8-4e7d90df72d5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:09.084156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a9726bcb-ccde-4e5c-aba8-4e7d90df72d5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:09.085214 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a9726bcb-ccde-4e5c-aba8-4e7d90df72d5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:09.086430 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a9726bcb-ccde-4e5c-aba8-4e7d90df72d5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:09.233323 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a9726bcb-ccde-4e5c-aba8-4e7d90df72d5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:09.241903 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a9726bcb-ccde-4e5c-aba8-4e7d90df72d5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.169048 Feb 21 02:35:09.242586 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 423/870] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:09 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:09.544351 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:09.544927 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:09.551229 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:09.551730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:09.552874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:09.553491 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:09.696577 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:09.705272 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:09.706803 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:09.708887 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-79719b10-60aa-49fb-9e52-b6a8063bd7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.167432 Feb 21 02:35:09.709730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 448/871] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:09 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:09.754422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-74afef82-39ed-4bc4-ba95-77e1521ed655 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:09.755696 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-74afef82-39ed-4bc4-ba95-77e1521ed655 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:09.762552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-74afef82-39ed-4bc4-ba95-77e1521ed655 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:09.763097 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-74afef82-39ed-4bc4-ba95-77e1521ed655 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:09.764013 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-74afef82-39ed-4bc4-ba95-77e1521ed655 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:09.764490 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-74afef82-39ed-4bc4-ba95-77e1521ed655 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:09.906223 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-74afef82-39ed-4bc4-ba95-77e1521ed655 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:09.913786 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-74afef82-39ed-4bc4-ba95-77e1521ed655 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.162905 Feb 21 02:35:09.914560 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 424/872] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:09 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:10.258582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-48416bfc-3e7b-429a-8453-15164dac93a7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:10.259242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-48416bfc-3e7b-429a-8453-15164dac93a7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:10.266068 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-48416bfc-3e7b-429a-8453-15164dac93a7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:10.266624 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-48416bfc-3e7b-429a-8453-15164dac93a7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:10.267453 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-48416bfc-3e7b-429a-8453-15164dac93a7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:10.267893 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-48416bfc-3e7b-429a-8453-15164dac93a7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:10.460198 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-48416bfc-3e7b-429a-8453-15164dac93a7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:10.468889 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-48416bfc-3e7b-429a-8453-15164dac93a7 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.214163 Feb 21 02:35:10.470390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 449/873] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:10 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:10.728363 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:10.728894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:10.735146 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:10.735586 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:10.736354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:10.736779 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:10.883290 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:10.891770 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:10.893255 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:10.894450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-23da9428-16ea-4ce5-a36b-199473cf0a27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.171003 Feb 21 02:35:10.895010 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 425/874] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:10 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:10.931127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-1131803f-2d7e-41d2-8eba-13dfee38b504 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:10.931787 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-1131803f-2d7e-41d2-8eba-13dfee38b504 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:10.938305 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1131803f-2d7e-41d2-8eba-13dfee38b504 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:10.939126 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1131803f-2d7e-41d2-8eba-13dfee38b504 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:10.940191 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1131803f-2d7e-41d2-8eba-13dfee38b504 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:10.940730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-1131803f-2d7e-41d2-8eba-13dfee38b504 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:11.092748 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-1131803f-2d7e-41d2-8eba-13dfee38b504 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:11.101334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-1131803f-2d7e-41d2-8eba-13dfee38b504 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.173824 Feb 21 02:35:11.102164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 450/875] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:10 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:11.487235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-dc34b74e-51a8-4f87-a820-474bc9c5c624 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:11.487896 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-dc34b74e-51a8-4f87-a820-474bc9c5c624 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:11.494343 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dc34b74e-51a8-4f87-a820-474bc9c5c624 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:11.494786 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dc34b74e-51a8-4f87-a820-474bc9c5c624 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:11.495649 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dc34b74e-51a8-4f87-a820-474bc9c5c624 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:11.496038 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-dc34b74e-51a8-4f87-a820-474bc9c5c624 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:11.637394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-dc34b74e-51a8-4f87-a820-474bc9c5c624 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:11.644763 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-dc34b74e-51a8-4f87-a820-474bc9c5c624 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.161703 Feb 21 02:35:11.654949 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 426/876] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:11 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:11.913065 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:11.913596 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:11.920132 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:11.920873 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:11.922084 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:11.922541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:12.071137 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:12.079646 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:12.081271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:12.082466 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-bec6b788-f510-4049-8c02-640ed5b0937d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.173466 Feb 21 02:35:12.083036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 451/877] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:11 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:12.119224 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e543d508-d4c0-4b78-8f86-b0e04ed4ef4e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:12.119827 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e543d508-d4c0-4b78-8f86-b0e04ed4ef4e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:12.127190 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e543d508-d4c0-4b78-8f86-b0e04ed4ef4e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:12.127712 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e543d508-d4c0-4b78-8f86-b0e04ed4ef4e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:12.128591 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e543d508-d4c0-4b78-8f86-b0e04ed4ef4e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:12.129088 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e543d508-d4c0-4b78-8f86-b0e04ed4ef4e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:12.280480 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e543d508-d4c0-4b78-8f86-b0e04ed4ef4e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:12.288761 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e543d508-d4c0-4b78-8f86-b0e04ed4ef4e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.173481 Feb 21 02:35:12.289590 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 427/878] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:12 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:12.662915 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4eeba505-7a85-443c-b2ac-a8c6ee9c5c0f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:12.663670 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4eeba505-7a85-443c-b2ac-a8c6ee9c5c0f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:12.669778 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4eeba505-7a85-443c-b2ac-a8c6ee9c5c0f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:12.670235 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4eeba505-7a85-443c-b2ac-a8c6ee9c5c0f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:12.671036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4eeba505-7a85-443c-b2ac-a8c6ee9c5c0f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:12.671550 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4eeba505-7a85-443c-b2ac-a8c6ee9c5c0f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:12.814638 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4eeba505-7a85-443c-b2ac-a8c6ee9c5c0f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:12.823033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4eeba505-7a85-443c-b2ac-a8c6ee9c5c0f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.164343 Feb 21 02:35:12.823610 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 452/879] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:12 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:13.102518 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:13.103117 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:13.110901 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:13.111347 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:13.112126 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:13.112553 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:13.259845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:13.268408 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:13.270333 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:13.271512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8f725bf2-1097-43a2-a95d-759e199dd36b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.172815 Feb 21 02:35:13.272696 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 428/880] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:13 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:13.306199 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a4e3d924-519e-49a4-abca-e1b34c6174cc tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:13.306813 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a4e3d924-519e-49a4-abca-e1b34c6174cc tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:13.313306 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4e3d924-519e-49a4-abca-e1b34c6174cc tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:13.313785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4e3d924-519e-49a4-abca-e1b34c6174cc tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:13.314567 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4e3d924-519e-49a4-abca-e1b34c6174cc tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:13.315059 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a4e3d924-519e-49a4-abca-e1b34c6174cc tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:13.456640 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a4e3d924-519e-49a4-abca-e1b34c6174cc tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:13.464599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a4e3d924-519e-49a4-abca-e1b34c6174cc tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.162260 Feb 21 02:35:13.465362 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 453/881] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:13 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:13.839248 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fb4cf791-ce8f-4e27-ad19-8c42304ca163 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:13.839975 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fb4cf791-ce8f-4e27-ad19-8c42304ca163 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:13.846112 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fb4cf791-ce8f-4e27-ad19-8c42304ca163 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:13.846609 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fb4cf791-ce8f-4e27-ad19-8c42304ca163 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:13.847388 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fb4cf791-ce8f-4e27-ad19-8c42304ca163 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:13.847822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fb4cf791-ce8f-4e27-ad19-8c42304ca163 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:13.989422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fb4cf791-ce8f-4e27-ad19-8c42304ca163 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:13.997512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fb4cf791-ce8f-4e27-ad19-8c42304ca163 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.161907 Feb 21 02:35:13.998111 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 429/882] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:13 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:14.291307 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:14.291923 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:14.298171 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:14.298629 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:14.299423 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:14.299864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:14.446106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:14.454657 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:14.456112 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:14.457309 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-678832db-b479-4c83-af2a-0a0aae03340e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.170293 Feb 21 02:35:14.458062 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 454/883] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:14 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:14.481193 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-647222c1-5681-41a3-8e4e-2158e0ce7046 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:14.482620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-647222c1-5681-41a3-8e4e-2158e0ce7046 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:14.489610 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-647222c1-5681-41a3-8e4e-2158e0ce7046 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:14.490188 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-647222c1-5681-41a3-8e4e-2158e0ce7046 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:14.491525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-647222c1-5681-41a3-8e4e-2158e0ce7046 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:14.492068 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-647222c1-5681-41a3-8e4e-2158e0ce7046 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:14.636882 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-647222c1-5681-41a3-8e4e-2158e0ce7046 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:14.644311 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-647222c1-5681-41a3-8e4e-2158e0ce7046 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.166738 Feb 21 02:35:14.644881 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 430/884] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:14 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:15.014703 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-87b2a2b0-248d-49ff-b91a-3eac56bf06b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:15.015699 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-87b2a2b0-248d-49ff-b91a-3eac56bf06b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:15.022762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-87b2a2b0-248d-49ff-b91a-3eac56bf06b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:15.023261 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-87b2a2b0-248d-49ff-b91a-3eac56bf06b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:15.024145 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-87b2a2b0-248d-49ff-b91a-3eac56bf06b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:15.024662 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-87b2a2b0-248d-49ff-b91a-3eac56bf06b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:15.170820 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-87b2a2b0-248d-49ff-b91a-3eac56bf06b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:15.179047 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-87b2a2b0-248d-49ff-b91a-3eac56bf06b6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.168063 Feb 21 02:35:15.179628 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 455/885] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:15 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:15.477989 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:15.478295 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:15.484194 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:15.485082 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:15.485915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:15.486351 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:15.628255 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:15.637397 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:15.638900 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:15.640054 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7686a519-470e-4306-aeac-ad4b3dae2da1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.167910 Feb 21 02:35:15.640613 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 431/886] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:15 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:15.660585 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0440e502-24f9-4dc7-ab80-742927c867a6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:15.661331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0440e502-24f9-4dc7-ab80-742927c867a6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:15.668087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0440e502-24f9-4dc7-ab80-742927c867a6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:15.668534 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0440e502-24f9-4dc7-ab80-742927c867a6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:15.669383 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0440e502-24f9-4dc7-ab80-742927c867a6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:15.669786 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0440e502-24f9-4dc7-ab80-742927c867a6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:15.863234 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0440e502-24f9-4dc7-ab80-742927c867a6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:15.871763 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0440e502-24f9-4dc7-ab80-742927c867a6 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.214862 Feb 21 02:35:15.872370 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 456/887] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:15 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:16.196647 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a2fd456c-0bc2-4b7f-98ad-802634016454 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:16.197174 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a2fd456c-0bc2-4b7f-98ad-802634016454 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:16.203011 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2fd456c-0bc2-4b7f-98ad-802634016454 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.203460 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2fd456c-0bc2-4b7f-98ad-802634016454 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.204231 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2fd456c-0bc2-4b7f-98ad-802634016454 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.204663 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-a2fd456c-0bc2-4b7f-98ad-802634016454 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.282006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-09f430e2-2c37-4af7-866f-bddf14cc305a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:16.283038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-09f430e2-2c37-4af7-866f-bddf14cc305a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:16.288905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09f430e2-2c37-4af7-866f-bddf14cc305a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.289369 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09f430e2-2c37-4af7-866f-bddf14cc305a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.290233 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09f430e2-2c37-4af7-866f-bddf14cc305a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.290664 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09f430e2-2c37-4af7-866f-bddf14cc305a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.319351 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-09f430e2-2c37-4af7-866f-bddf14cc305a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040505 Feb 21 02:35:16.319921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 457/888] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:35:16 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 02:35:16.345394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a2fd456c-0bc2-4b7f-98ad-802634016454 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:16.352821 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a2fd456c-0bc2-4b7f-98ad-802634016454 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.160653 Feb 21 02:35:16.353474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 432/889] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:16 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:16.374645 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-531758ab-ba00-45d6-ac0c-5b73a18463d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:16.375137 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-531758ab-ba00-45d6-ac0c-5b73a18463d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:16.381463 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-531758ab-ba00-45d6-ac0c-5b73a18463d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.382049 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-531758ab-ba00-45d6-ac0c-5b73a18463d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.382821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-531758ab-ba00-45d6-ac0c-5b73a18463d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.383254 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-531758ab-ba00-45d6-ac0c-5b73a18463d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.407454 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-531758ab-ba00-45d6-ac0c-5b73a18463d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:35:16.478363 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-531758ab-ba00-45d6-ac0c-5b73a18463d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 204 len: 0 microversion: 2.1 time: 0.106957 Feb 21 02:35:16.478864 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 458/890] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:35:16 2022] DELETE /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:35:16.487125 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-aadb19e8-c0dd-4e6a-817f-d2dfb87977e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:16.487739 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-aadb19e8-c0dd-4e6a-817f-d2dfb87977e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:16.494838 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aadb19e8-c0dd-4e6a-817f-d2dfb87977e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.495384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aadb19e8-c0dd-4e6a-817f-d2dfb87977e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.496230 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aadb19e8-c0dd-4e6a-817f-d2dfb87977e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.496676 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aadb19e8-c0dd-4e6a-817f-d2dfb87977e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.629841 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aadb19e8-c0dd-4e6a-817f-d2dfb87977e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:16.637868 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-aadb19e8-c0dd-4e6a-817f-d2dfb87977e1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1673 microversion: 2.1 time: 0.154626 Feb 21 02:35:16.638440 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 433/891] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:16 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:16.661031 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:16.661768 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:16.667867 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.668309 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.669075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.669510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.812414 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:16.825322 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:16.826856 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:16.828010 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-519fab7d-58b3-4fd7-bf01-6a1b6ac10a6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.171892 Feb 21 02:35:16.828575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 459/892] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:16 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:16.890827 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-90dd6371-472b-4905-9471-046d5a4740e7 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:16.891619 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-90dd6371-472b-4905-9471-046d5a4740e7 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:16.898762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-90dd6371-472b-4905-9471-046d5a4740e7 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.899222 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-90dd6371-472b-4905-9471-046d5a4740e7 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:16.900011 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-90dd6371-472b-4905-9471-046d5a4740e7 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:16.900443 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-90dd6371-472b-4905-9471-046d5a4740e7 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:17.072562 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-90dd6371-472b-4905-9471-046d5a4740e7 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:17.080925 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-90dd6371-472b-4905-9471-046d5a4740e7 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.195058 Feb 21 02:35:17.081489 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 434/893] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:16 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:17.370173 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d290eacf-a347-4f7d-bdfa-3540478378cd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:17.370817 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d290eacf-a347-4f7d-bdfa-3540478378cd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:17.378425 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d290eacf-a347-4f7d-bdfa-3540478378cd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:17.378942 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d290eacf-a347-4f7d-bdfa-3540478378cd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:17.379736 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d290eacf-a347-4f7d-bdfa-3540478378cd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:17.380179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d290eacf-a347-4f7d-bdfa-3540478378cd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:17.515092 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d290eacf-a347-4f7d-bdfa-3540478378cd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:17.523039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d290eacf-a347-4f7d-bdfa-3540478378cd tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.156642 Feb 21 02:35:17.523603 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 460/894] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:17 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:17.655676 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e5364806-a6ec-4342-a19d-6d4cb700829d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:17.656310 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e5364806-a6ec-4342-a19d-6d4cb700829d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:17.662565 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e5364806-a6ec-4342-a19d-6d4cb700829d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:17.663008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e5364806-a6ec-4342-a19d-6d4cb700829d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:17.663876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e5364806-a6ec-4342-a19d-6d4cb700829d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:17.664312 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e5364806-a6ec-4342-a19d-6d4cb700829d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:17.801961 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e5364806-a6ec-4342-a19d-6d4cb700829d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:17.809282 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e5364806-a6ec-4342-a19d-6d4cb700829d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1673 microversion: 2.1 time: 0.157296 Feb 21 02:35:17.809870 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 435/895] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:17 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:17.846678 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:17.847276 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:17.853476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:17.853962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:17.854729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:17.855159 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:17.988516 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:17.997302 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:17.998814 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:17.999950 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5421ba8e-fde2-48e0-a2eb-35a1594a9563 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.156947 Feb 21 02:35:18.000504 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 461/896] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:17 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:18.096685 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c19a1a0e-1005-4755-b6ad-e67a974870b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:18.097284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c19a1a0e-1005-4755-b6ad-e67a974870b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:18.103145 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c19a1a0e-1005-4755-b6ad-e67a974870b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:18.103583 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c19a1a0e-1005-4755-b6ad-e67a974870b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:18.104342 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c19a1a0e-1005-4755-b6ad-e67a974870b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:18.104764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c19a1a0e-1005-4755-b6ad-e67a974870b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:18.235818 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c19a1a0e-1005-4755-b6ad-e67a974870b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:18.243720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c19a1a0e-1005-4755-b6ad-e67a974870b9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.150640 Feb 21 02:35:18.244275 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 436/897] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:18 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:18.540403 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-20a5886a-542b-44df-9e03-8b9ea911992d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:18.540929 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-20a5886a-542b-44df-9e03-8b9ea911992d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:18.546719 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-20a5886a-542b-44df-9e03-8b9ea911992d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:18.547159 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-20a5886a-542b-44df-9e03-8b9ea911992d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:18.547924 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-20a5886a-542b-44df-9e03-8b9ea911992d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:18.548354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-20a5886a-542b-44df-9e03-8b9ea911992d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:18.678803 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-20a5886a-542b-44df-9e03-8b9ea911992d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:18.685941 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-20a5886a-542b-44df-9e03-8b9ea911992d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.149893 Feb 21 02:35:18.686511 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 462/898] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:18 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:18.826616 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b0806593-7765-4010-b152-558ec9f13b26 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:18.827172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b0806593-7765-4010-b152-558ec9f13b26 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:18.833477 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0806593-7765-4010-b152-558ec9f13b26 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:18.834653 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0806593-7765-4010-b152-558ec9f13b26 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:18.835619 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0806593-7765-4010-b152-558ec9f13b26 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:18.836182 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b0806593-7765-4010-b152-558ec9f13b26 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:18.972643 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b0806593-7765-4010-b152-558ec9f13b26 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:18.981450 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b0806593-7765-4010-b152-558ec9f13b26 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1673 microversion: 2.1 time: 0.158589 Feb 21 02:35:18.982053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 437/899] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:18 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:19.017666 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:19.018280 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:19.025081 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:19.025518 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:19.026311 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:19.026740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:19.162076 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:19.170092 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:19.171564 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:19.172700 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-cafc8d7f-096b-481c-b9ce-6d7e6b302fa3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.158680 Feb 21 02:35:19.173247 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 463/900] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:19 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:19.260972 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-95b18ddf-15c9-45b6-ab55-c1783f71f41e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:19.261568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-95b18ddf-15c9-45b6-ab55-c1783f71f41e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:19.267380 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-95b18ddf-15c9-45b6-ab55-c1783f71f41e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:19.267820 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-95b18ddf-15c9-45b6-ab55-c1783f71f41e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:19.268581 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-95b18ddf-15c9-45b6-ab55-c1783f71f41e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:19.269005 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-95b18ddf-15c9-45b6-ab55-c1783f71f41e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:19.402432 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-95b18ddf-15c9-45b6-ab55-c1783f71f41e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:19.409692 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-95b18ddf-15c9-45b6-ab55-c1783f71f41e tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.152292 Feb 21 02:35:19.410258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 438/901] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:19 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:19.702362 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-006ed229-7f3f-4dce-915d-1805672aaa4f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:19.703002 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-006ed229-7f3f-4dce-915d-1805672aaa4f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:19.708905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-006ed229-7f3f-4dce-915d-1805672aaa4f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:19.709516 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-006ed229-7f3f-4dce-915d-1805672aaa4f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:19.710433 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-006ed229-7f3f-4dce-915d-1805672aaa4f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:19.710903 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-006ed229-7f3f-4dce-915d-1805672aaa4f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:19.846514 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-006ed229-7f3f-4dce-915d-1805672aaa4f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:19.854658 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-006ed229-7f3f-4dce-915d-1805672aaa4f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1265 microversion: 2.1 time: 0.155867 Feb 21 02:35:19.855227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 464/902] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:19 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:19.999089 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-81b9e8ba-e2ec-4aeb-a8b7-6764c80ff4df tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:19.999613 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-81b9e8ba-e2ec-4aeb-a8b7-6764c80ff4df tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:20.005361 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-81b9e8ba-e2ec-4aeb-a8b7-6764c80ff4df tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:20.006413 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-81b9e8ba-e2ec-4aeb-a8b7-6764c80ff4df tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:20.007221 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-81b9e8ba-e2ec-4aeb-a8b7-6764c80ff4df tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:20.007654 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-81b9e8ba-e2ec-4aeb-a8b7-6764c80ff4df tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:20.152354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-81b9e8ba-e2ec-4aeb-a8b7-6764c80ff4df tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:20.159593 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-81b9e8ba-e2ec-4aeb-a8b7-6764c80ff4df tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1673 microversion: 2.1 time: 0.164399 Feb 21 02:35:20.160157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 439/903] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:19 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:20.190655 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:20.191293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:20.198225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:20.198670 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:20.199444 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:20.199877 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:20.335649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:20.343768 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:20.345252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:20.346448 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9fa4a4f2-a4f7-4e8c-b807-ff67926ab925 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.159496 Feb 21 02:35:20.347005 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 465/904] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:20 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:20.426876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-342a1494-569b-4647-952a-a8825cc54583 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:20.427479 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-342a1494-569b-4647-952a-a8825cc54583 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:20.433860 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-342a1494-569b-4647-952a-a8825cc54583 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:20.434304 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-342a1494-569b-4647-952a-a8825cc54583 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:20.435072 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-342a1494-569b-4647-952a-a8825cc54583 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:20.435500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-342a1494-569b-4647-952a-a8825cc54583 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:20.654284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-342a1494-569b-4647-952a-a8825cc54583 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:20.661509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-342a1494-569b-4647-952a-a8825cc54583 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.238334 Feb 21 02:35:20.662131 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 440/905] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:20 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:20.871387 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-726086d0-1351-42c1-8fbb-da162e44ca0c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:20.871988 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-726086d0-1351-42c1-8fbb-da162e44ca0c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:20.877738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-726086d0-1351-42c1-8fbb-da162e44ca0c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:20.878216 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-726086d0-1351-42c1-8fbb-da162e44ca0c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:20.878992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-726086d0-1351-42c1-8fbb-da162e44ca0c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:20.879427 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-726086d0-1351-42c1-8fbb-da162e44ca0c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.022947 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-726086d0-1351-42c1-8fbb-da162e44ca0c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:21.030589 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-726086d0-1351-42c1-8fbb-da162e44ca0c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1452 microversion: 2.1 time: 0.162764 Feb 21 02:35:21.031441 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 466/906] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:20 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:21.046640 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-338938b3-2b3a-402c-adaf-bb6685a24ba9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:21.047270 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-338938b3-2b3a-402c-adaf-bb6685a24ba9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:21.054186 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-338938b3-2b3a-402c-adaf-bb6685a24ba9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.054639 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-338938b3-2b3a-402c-adaf-bb6685a24ba9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.055424 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-338938b3-2b3a-402c-adaf-bb6685a24ba9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.055862 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-338938b3-2b3a-402c-adaf-bb6685a24ba9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.176273 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-cd3fece2-f6f2-4d8e-be35-2742b39f4323 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:21.176885 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-cd3fece2-f6f2-4d8e-be35-2742b39f4323 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:21.183741 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cd3fece2-f6f2-4d8e-be35-2742b39f4323 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.184196 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cd3fece2-f6f2-4d8e-be35-2742b39f4323 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.184989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cd3fece2-f6f2-4d8e-be35-2742b39f4323 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.185430 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cd3fece2-f6f2-4d8e-be35-2742b39f4323 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.246253 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cd3fece2-f6f2-4d8e-be35-2742b39f4323 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:21.253452 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-cd3fece2-f6f2-4d8e-be35-2742b39f4323 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 200 len: 1605 microversion: 2.1 time: 0.080843 Feb 21 02:35:21.254124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 467/907] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:21 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 1605 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:35:21.301392 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-338938b3-2b3a-402c-adaf-bb6685a24ba9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:21.309561 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-338938b3-2b3a-402c-adaf-bb6685a24ba9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1452 microversion: 2.1 time: 0.266516 Feb 21 02:35:21.310270 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 441/908] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:21 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1452 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:21.366621 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:21.367655 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:21.383929 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-5c3acfcc-73ed-4dd1-9d99-ba6a0797e5a5 req-01f66f57-754f-40e2-85fd-0259703e8723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af65eb3-dbe6-4a66-919e-c8a6884b613c", "name": "network-vif-deleted", "tag": "754d6b40-0964-484e-9d3d-46275c69f4cb"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:21.385776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:21.385776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:35:21.389797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.392541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.393446 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.394016 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.401310 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-5c3acfcc-73ed-4dd1-9d99-ba6a0797e5a5 req-01f66f57-754f-40e2-85fd-0259703e8723 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.401779 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-5c3acfcc-73ed-4dd1-9d99-ba6a0797e5a5 req-01f66f57-754f-40e2-85fd-0259703e8723 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.431961 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-5c3acfcc-73ed-4dd1-9d99-ba6a0797e5a5 req-01f66f57-754f-40e2-85fd-0259703e8723 service nova] Creating event network-vif-deleted:754d6b40-0964-484e-9d3d-46275c69f4cb for instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c on hv-cinder-80447 Feb 21 02:35:21.445735 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-5c3acfcc-73ed-4dd1-9d99-ba6a0797e5a5 req-01f66f57-754f-40e2-85fd-0259703e8723 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062598 Feb 21 02:35:21.446664 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 442/909] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:21.614464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:21.624075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:21.625575 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:21.626766 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-da67c748-d7ec-4634-8d78-ce3156c41eae tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.266078 Feb 21 02:35:21.627715 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 468/910] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:21 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:21.679778 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-afc9797c-c63f-41b0-9811-e8252e391600 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:21.680471 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-afc9797c-c63f-41b0-9811-e8252e391600 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:21.686940 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-afc9797c-c63f-41b0-9811-e8252e391600 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.687316 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-afc9797c-c63f-41b0-9811-e8252e391600 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.688280 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-afc9797c-c63f-41b0-9811-e8252e391600 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:21.688943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-afc9797c-c63f-41b0-9811-e8252e391600 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:21.926185 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-afc9797c-c63f-41b0-9811-e8252e391600 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:21.935419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-afc9797c-c63f-41b0-9811-e8252e391600 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.259863 Feb 21 02:35:21.938497 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 443/911] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:21 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:22.271018 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:22.272638 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:22.278903 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:22.279580 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:22.280404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:22.280815 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:22.295504 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] HTTP exception thrown: Instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c could not be found. Feb 21 02:35:22.296388 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Returning 404 to user: Instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:35:22.297297 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-90229c26-7ea6-4a2a-afec-edd2b231b58a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 404 len: 111 microversion: 2.1 time: 0.029909 Feb 21 02:35:22.297940 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 469/912] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:22 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 02:35:22.307266 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-add10f86-8c4c-47ef-985d-76bb5069aad0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '.version_select at 0x7fd85c08bc10>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:22.335597 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-add10f86-8c4c-47ef-985d-76bb5069aad0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-105809162" status: 202 len: 0 microversion: 2.1 time: 0.032563 Feb 21 02:35:22.336481 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 444/913] 10.222.0.75 () {58 vars in 1217 bytes} [Mon Feb 21 02:35:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-105809162 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:35:22.645181 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:22.646730 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:22.655354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:22.655886 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:22.656776 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:22.657375 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:22.923384 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:22.934637 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:22.936130 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:22.937295 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-9c965b5c-5631-4998-bd8f-df474a0bcbbf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.295944 Feb 21 02:35:22.945834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 470/914] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:22 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:22.952288 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fae9dcf5-8260-4d7b-bb77-5aa4eb8465f0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:22.953516 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fae9dcf5-8260-4d7b-bb77-5aa4eb8465f0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:22.961328 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fae9dcf5-8260-4d7b-bb77-5aa4eb8465f0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:22.961886 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fae9dcf5-8260-4d7b-bb77-5aa4eb8465f0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:22.962745 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fae9dcf5-8260-4d7b-bb77-5aa4eb8465f0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:22.963251 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fae9dcf5-8260-4d7b-bb77-5aa4eb8465f0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:23.128137 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c21509ea-5169-4b88-bf43-8e5c264965be tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'create', calling method: .version_select at 0x7fd85c148550>, body: {"keypair": {"name": "tempest-keypair-1054968600"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:23.141767 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-c21509ea-5169-4b88-bf43-8e5c264965be tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for project 09e923a4cc944b28979de727cb5269d1. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:35:23.145814 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-c21509ea-5169-4b88-bf43-8e5c264965be tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for user 30239e42418b4e33bdc1b9fb30b45004 and project 09e923a4cc944b28979de727cb5269d1. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:35:23.211625 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fae9dcf5-8260-4d7b-bb77-5aa4eb8465f0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:23.218980 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fae9dcf5-8260-4d7b-bb77-5aa4eb8465f0 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.270558 Feb 21 02:35:23.219634 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 445/915] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:22 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:35:23.358507 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-c21509ea-5169-4b88-bf43-8e5c264965be tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for project 09e923a4cc944b28979de727cb5269d1. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:35:23.369862 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-c21509ea-5169-4b88-bf43-8e5c264965be tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for user 30239e42418b4e33bdc1b9fb30b45004 and project 09e923a4cc944b28979de727cb5269d1. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:35:23.384043 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c21509ea-5169-4b88-bf43-8e5c264965be tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.260246 Feb 21 02:35:23.384828 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 471/916] 10.222.0.75 () {60 vars in 1157 bytes} [Mon Feb 21 02:35:23 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:23.543100 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-8ea7c67a-48d4-42e2-bbdc-e216e52370ee req-54d85685-22db-4d10-be7e-09b5dde09daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44f197d-6813-4c77-8283-ce1b523de6cd", "tag": "b9cfa993-4c52-40b7-9623-8c41c63c23f3"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:23.545821 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:23.545821 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:35:23.554554 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-8ea7c67a-48d4-42e2-bbdc-e216e52370ee req-54d85685-22db-4d10-be7e-09b5dde09daf service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:23.555236 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-8ea7c67a-48d4-42e2-bbdc-e216e52370ee req-54d85685-22db-4d10-be7e-09b5dde09daf service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:23.566882 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-8ea7c67a-48d4-42e2-bbdc-e216e52370ee req-54d85685-22db-4d10-be7e-09b5dde09daf service nova] Creating event network-changed:b9cfa993-4c52-40b7-9623-8c41c63c23f3 for instance f44f197d-6813-4c77-8283-ce1b523de6cd on hv-cinder-80447 Feb 21 02:35:23.573105 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-8ea7c67a-48d4-42e2-bbdc-e216e52370ee req-54d85685-22db-4d10-be7e-09b5dde09daf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033678 Feb 21 02:35:23.574318 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 446/917] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:23.957295 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:23.958502 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:23.969766 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:23.970603 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:23.972007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:23.973522 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:24.215968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:24.227408 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:24.228966 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:24.231301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e5c14b0a-3a5d-436d-ad3c-6604c05a4db9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.278699 Feb 21 02:35:24.237717 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 472/918] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:23 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:24.242985 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c3dd2486-a555-4615-9d2b-c35670d88e0d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:24.243690 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c3dd2486-a555-4615-9d2b-c35670d88e0d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:24.250021 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c3dd2486-a555-4615-9d2b-c35670d88e0d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:24.250751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c3dd2486-a555-4615-9d2b-c35670d88e0d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:24.251540 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c3dd2486-a555-4615-9d2b-c35670d88e0d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:24.251972 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c3dd2486-a555-4615-9d2b-c35670d88e0d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:24.414258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c3dd2486-a555-4615-9d2b-c35670d88e0d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:24.423337 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c3dd2486-a555-4615-9d2b-c35670d88e0d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.184997 Feb 21 02:35:24.424039 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 447/919] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:24 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:24.808333 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1743319399", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7984c99a-2bf0-4380-ab96-7d2375b9f90f"}], "security_groups": [{"name": "tempest-securitygroup--1407584787"}], "key_name": "tempest-keypair-1054968600", "user_data": "}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:24.913169 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] validate_networks() for [('7984c99a-2bf0-4380-ab96-7d2375b9f90f', None, None, None, None, None)] {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:35:25.249186 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:25.249831 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:25.256055 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:25.256500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:25.257271 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:25.257726 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:25.283457 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:35:25.283895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:35:25.284365 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:35:25.284780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:35:25.285189 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:35:25.294882 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:25.295337 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:25.296156 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:25.296598 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:25.314545 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for project 09e923a4cc944b28979de727cb5269d1. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:35:25.319327 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Getting quotas for user 30239e42418b4e33bdc1b9fb30b45004 and project 09e923a4cc944b28979de727cb5269d1. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:35:25.338666 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:35:25.341357 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:35:25.391049 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3c30525f-25fd-4abf-a7ee-f6b28ee93199 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586862 Feb 21 02:35:25.396871 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 473/920] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:35:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:35:25.401629 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-786ec723-1441-42e9-a460-f8144cb23e16 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:25.402263 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-786ec723-1441-42e9-a460-f8144cb23e16 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:25.433083 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:25.446934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:25.448648 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:25.449989 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-14cb9f73-8e18-4566-8272-3292aa05f408 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.204441 Feb 21 02:35:25.462357 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 448/921] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:25 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:35:25.469507 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-04ca2a79-fae7-42ec-a4ab-ff304ed59054 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:25.470311 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-04ca2a79-fae7-42ec-a4ab-ff304ed59054 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:25.471546 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-786ec723-1441-42e9-a460-f8144cb23e16 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:25.477294 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-04ca2a79-fae7-42ec-a4ab-ff304ed59054 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:25.477973 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-04ca2a79-fae7-42ec-a4ab-ff304ed59054 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:25.478908 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-04ca2a79-fae7-42ec-a4ab-ff304ed59054 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:25.479600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-04ca2a79-fae7-42ec-a4ab-ff304ed59054 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:25.480510 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-786ec723-1441-42e9-a460-f8144cb23e16 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1238 microversion: 2.1 time: 0.082413 Feb 21 02:35:25.489920 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 474/922] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:25 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:35:25.489920 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-e56e6d82-548f-4d4c-bd24-60f198101f7d req-73f2aa59-5858-4e7f-b0ee-4ca9096dc653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fd287f-356c-4485-ba82-bbe3da3cf5ba", "name": "network-vif-plugged", "status": "completed", "tag": "212cff7d-b04b-4efb-be92-6dd1bd6ec779"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:25.489920 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:25.489920 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:35:25.496797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-e56e6d82-548f-4d4c-bd24-60f198101f7d req-73f2aa59-5858-4e7f-b0ee-4ca9096dc653 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:25.497253 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-e56e6d82-548f-4d4c-bd24-60f198101f7d req-73f2aa59-5858-4e7f-b0ee-4ca9096dc653 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:25.514644 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-e56e6d82-548f-4d4c-bd24-60f198101f7d req-73f2aa59-5858-4e7f-b0ee-4ca9096dc653 service nova] Creating event network-vif-plugged:212cff7d-b04b-4efb-be92-6dd1bd6ec779 for instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba on hv-cinder-80447 Feb 21 02:35:25.520228 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-e56e6d82-548f-4d4c-bd24-60f198101f7d req-73f2aa59-5858-4e7f-b0ee-4ca9096dc653 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037408 Feb 21 02:35:25.522117 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 475/923] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:25.645422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-04ca2a79-fae7-42ec-a4ab-ff304ed59054 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:25.653740 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-04ca2a79-fae7-42ec-a4ab-ff304ed59054 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.189887 Feb 21 02:35:25.654923 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 449/924] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:25 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:26.469733 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:26.470516 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:26.476727 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:26.477165 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:26.477968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:26.478400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:26.497313 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9bee3dc3-2f8b-497a-a4c4-2af90b3319d0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:26.503869 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9bee3dc3-2f8b-497a-a4c4-2af90b3319d0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:26.504987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9bee3dc3-2f8b-497a-a4c4-2af90b3319d0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:26.505547 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9bee3dc3-2f8b-497a-a4c4-2af90b3319d0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:26.507063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9bee3dc3-2f8b-497a-a4c4-2af90b3319d0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:26.507691 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9bee3dc3-2f8b-497a-a4c4-2af90b3319d0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:26.575848 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9bee3dc3-2f8b-497a-a4c4-2af90b3319d0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:26.583375 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9bee3dc3-2f8b-497a-a4c4-2af90b3319d0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1290 microversion: 2.1 time: 0.089717 Feb 21 02:35:26.584603 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 450/925] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:26 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:35:26.630325 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:26.641040 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:26.642672 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:26.643971 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-38ceed41-e142-4b44-9314-51a79f6909f7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.178842 Feb 21 02:35:26.645683 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 476/926] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:26 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:26.672023 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f942ad82-2a0b-48a9-9b48-16ccf3e5ddf9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:26.672644 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f942ad82-2a0b-48a9-9b48-16ccf3e5ddf9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:26.678815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f942ad82-2a0b-48a9-9b48-16ccf3e5ddf9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:26.679286 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f942ad82-2a0b-48a9-9b48-16ccf3e5ddf9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:26.680060 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f942ad82-2a0b-48a9-9b48-16ccf3e5ddf9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:26.680491 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f942ad82-2a0b-48a9-9b48-16ccf3e5ddf9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:26.928136 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f942ad82-2a0b-48a9-9b48-16ccf3e5ddf9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:26.935391 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f942ad82-2a0b-48a9-9b48-16ccf3e5ddf9 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1575 microversion: 2.1 time: 0.267165 Feb 21 02:35:26.935958 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 451/927] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:26 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1575 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:27.600040 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b9c36702-f7d7-45bc-a332-fdd019e5df75 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:27.600641 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b9c36702-f7d7-45bc-a332-fdd019e5df75 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:27.606872 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9c36702-f7d7-45bc-a332-fdd019e5df75 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:27.607314 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9c36702-f7d7-45bc-a332-fdd019e5df75 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:27.608085 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9c36702-f7d7-45bc-a332-fdd019e5df75 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:27.608517 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b9c36702-f7d7-45bc-a332-fdd019e5df75 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:27.663656 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:27.664407 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:27.670893 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:27.671441 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:27.672477 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:27.673149 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:27.752704 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b9c36702-f7d7-45bc-a332-fdd019e5df75 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:27.760557 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b9c36702-f7d7-45bc-a332-fdd019e5df75 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.164166 Feb 21 02:35:27.761141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 477/928] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:27 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:27.882684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:27.891292 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:27.892776 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:27.893965 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b618aeef-c489-482f-8ae3-9c75f66d422c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.234576 Feb 21 02:35:27.894525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 452/929] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:27 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:35:27.955525 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2916cf9f-a838-49fe-90a5-94c8efa63309 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:27.956283 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2916cf9f-a838-49fe-90a5-94c8efa63309 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:27.969448 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2916cf9f-a838-49fe-90a5-94c8efa63309 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:27.969945 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2916cf9f-a838-49fe-90a5-94c8efa63309 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:27.971480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2916cf9f-a838-49fe-90a5-94c8efa63309 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:27.971913 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2916cf9f-a838-49fe-90a5-94c8efa63309 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:28.117063 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2916cf9f-a838-49fe-90a5-94c8efa63309 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:28.124425 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2916cf9f-a838-49fe-90a5-94c8efa63309 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1562 microversion: 2.1 time: 0.172624 Feb 21 02:35:28.124992 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 478/930] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:27 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:28.171987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-bada8dda-7b06-4ba2-8f00-c4d13809c828 req-aed490a4-a8b3-4bd8-b5c6-4e98cad9f04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c933a35b-ab8d-4b24-ace9-75eec69b4f71", "tag": "748a7a21-04ad-4f5d-bec7-66ddae147215"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:28.174008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:28.174008 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:35:28.182120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-bada8dda-7b06-4ba2-8f00-c4d13809c828 req-aed490a4-a8b3-4bd8-b5c6-4e98cad9f04a service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:28.182827 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-bada8dda-7b06-4ba2-8f00-c4d13809c828 req-aed490a4-a8b3-4bd8-b5c6-4e98cad9f04a service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:28.198721 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-bada8dda-7b06-4ba2-8f00-c4d13809c828 req-aed490a4-a8b3-4bd8-b5c6-4e98cad9f04a service nova] Creating event network-changed:748a7a21-04ad-4f5d-bec7-66ddae147215 for instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 on hv-cinder-80447 Feb 21 02:35:28.205035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-bada8dda-7b06-4ba2-8f00-c4d13809c828 req-aed490a4-a8b3-4bd8-b5c6-4e98cad9f04a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039761 Feb 21 02:35:28.206396 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 453/931] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:28.778247 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b58b9e5b-e328-4254-82ca-22881cc1d612 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:28.778977 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b58b9e5b-e328-4254-82ca-22881cc1d612 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:28.785262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b58b9e5b-e328-4254-82ca-22881cc1d612 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:28.785847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b58b9e5b-e328-4254-82ca-22881cc1d612 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:28.786626 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b58b9e5b-e328-4254-82ca-22881cc1d612 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:28.787821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b58b9e5b-e328-4254-82ca-22881cc1d612 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:28.914249 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:28.915032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:28.921098 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:28.921630 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:28.922542 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:28.923459 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:28.930745 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b58b9e5b-e328-4254-82ca-22881cc1d612 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:28.939197 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b58b9e5b-e328-4254-82ca-22881cc1d612 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.164630 Feb 21 02:35:28.939793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 479/932] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:28 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:29.152505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:29.160564 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:29.162108 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:29.163258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6ef65a82-2629-41f3-955b-75d13a070067 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.254185 Feb 21 02:35:29.163815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 454/933] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:28 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:35:29.956571 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e5c73d0c-20df-4be3-8b1f-f9b2486a6188 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:29.957101 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e5c73d0c-20df-4be3-8b1f-f9b2486a6188 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:29.963892 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e5c73d0c-20df-4be3-8b1f-f9b2486a6188 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:29.964336 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e5c73d0c-20df-4be3-8b1f-f9b2486a6188 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:29.965108 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e5c73d0c-20df-4be3-8b1f-f9b2486a6188 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:29.965537 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e5c73d0c-20df-4be3-8b1f-f9b2486a6188 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:30.097607 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e5c73d0c-20df-4be3-8b1f-f9b2486a6188 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:30.104765 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e5c73d0c-20df-4be3-8b1f-f9b2486a6188 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.151976 Feb 21 02:35:30.105346 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 480/934] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:29 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:30.181818 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:30.182419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:30.188572 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:30.189010 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:30.189809 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:30.190237 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:30.324593 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:30.332806 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:30.334635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:30.335771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-25163645-c63a-4173-aa5f-142132dda0c7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.158272 Feb 21 02:35:30.336378 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 455/935] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:30 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:31.121400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6d42dded-0128-454e-b74d-31962a7ba5c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:31.122043 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6d42dded-0128-454e-b74d-31962a7ba5c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:31.128428 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d42dded-0128-454e-b74d-31962a7ba5c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:31.128873 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d42dded-0128-454e-b74d-31962a7ba5c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:31.129658 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d42dded-0128-454e-b74d-31962a7ba5c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:31.130096 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d42dded-0128-454e-b74d-31962a7ba5c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:31.259540 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6d42dded-0128-454e-b74d-31962a7ba5c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:31.266781 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6d42dded-0128-454e-b74d-31962a7ba5c0 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.149024 Feb 21 02:35:31.267371 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 481/936] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:31 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:31.354068 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:31.354701 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:31.361156 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:31.361602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:31.362437 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:31.362870 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:31.453459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-964feb42-4270-4d63-b6ad-5577429fce05 req-1069efd9-10ab-4590-8779-23679d54411e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8e707-e1a8-46b8-8b47-ef1d9ef77903", "name": "network-vif-plugged", "status": "completed", "tag": "186e3f15-c158-44f9-a144-358d5ab62c8f"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:31.455348 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:31.455348 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:35:31.462945 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-964feb42-4270-4d63-b6ad-5577429fce05 req-1069efd9-10ab-4590-8779-23679d54411e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:31.463439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-964feb42-4270-4d63-b6ad-5577429fce05 req-1069efd9-10ab-4590-8779-23679d54411e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:31.479207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-964feb42-4270-4d63-b6ad-5577429fce05 req-1069efd9-10ab-4590-8779-23679d54411e service nova] Creating event network-vif-plugged:186e3f15-c158-44f9-a144-358d5ab62c8f for instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 on hv-cinder-80447 Feb 21 02:35:31.484190 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-964feb42-4270-4d63-b6ad-5577429fce05 req-1069efd9-10ab-4590-8779-23679d54411e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Feb 21 02:35:31.485231 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 482/937] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:35:31.503245 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:31.513589 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:31.515116 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:31.516274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9a5206f1-41b7-41f3-ba2b-6858370c60ca tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.165884 Feb 21 02:35:31.516828 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 456/938] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:31 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:32.285018 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-bf423074-ac22-43df-a37c-53d9c7572928 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:32.285743 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-bf423074-ac22-43df-a37c-53d9c7572928 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:32.291850 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bf423074-ac22-43df-a37c-53d9c7572928 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:32.292297 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bf423074-ac22-43df-a37c-53d9c7572928 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:32.293071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bf423074-ac22-43df-a37c-53d9c7572928 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:32.293507 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bf423074-ac22-43df-a37c-53d9c7572928 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:32.429175 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bf423074-ac22-43df-a37c-53d9c7572928 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:32.437889 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-bf423074-ac22-43df-a37c-53d9c7572928 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.157239 Feb 21 02:35:32.438521 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 483/939] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:32 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:32.534431 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:32.535065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:32.541894 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:32.542346 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:32.543128 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:32.543567 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:32.923118 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:32.931902 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:32.933379 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:32.934556 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ffe9e003-a9f9-4885-a3cb-8662e2000ef0 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.404053 Feb 21 02:35:32.935108 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 457/940] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:32 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:35:33.455159 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3660ae8f-5d9d-45cc-b1ef-1b24c46223c9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:33.455765 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3660ae8f-5d9d-45cc-b1ef-1b24c46223c9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:33.462874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3660ae8f-5d9d-45cc-b1ef-1b24c46223c9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:33.463320 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3660ae8f-5d9d-45cc-b1ef-1b24c46223c9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:33.464109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3660ae8f-5d9d-45cc-b1ef-1b24c46223c9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:33.464545 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3660ae8f-5d9d-45cc-b1ef-1b24c46223c9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:33.601140 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3660ae8f-5d9d-45cc-b1ef-1b24c46223c9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:33.608473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3660ae8f-5d9d-45cc-b1ef-1b24c46223c9 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.157090 Feb 21 02:35:33.609036 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 484/941] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:33 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:33.952239 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:33.953077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:33.960804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:33.961256 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:33.962077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:33.962509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:34.106409 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:34.114961 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:34.116812 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:34.118006 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-25bcf845-2980-4016-a72b-9e5f4da453cd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1810 microversion: 2.20 time: 0.169483 Feb 21 02:35:34.118556 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 458/942] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:33 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:34.625299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-037542ef-be1c-4775-ac26-b5b5b4a41339 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:34.625925 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-037542ef-be1c-4775-ac26-b5b5b4a41339 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:34.633041 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-037542ef-be1c-4775-ac26-b5b5b4a41339 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:34.633483 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-037542ef-be1c-4775-ac26-b5b5b4a41339 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:34.634280 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-037542ef-be1c-4775-ac26-b5b5b4a41339 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:34.634711 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-037542ef-be1c-4775-ac26-b5b5b4a41339 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:34.768267 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-037542ef-be1c-4775-ac26-b5b5b4a41339 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:34.776500 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-037542ef-be1c-4775-ac26-b5b5b4a41339 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.154850 Feb 21 02:35:34.777061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 485/943] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:34 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:35.137285 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:35.137941 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:35.144146 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:35.144624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:35.145406 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:35.145898 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:35.281264 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:35.289296 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:35.290790 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:35.291922 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-02aa84e4-f293-4a09-b92d-929766eace27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1797 microversion: 2.20 time: 0.158279 Feb 21 02:35:35.292480 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 459/944] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:35:35 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1797 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:35:35.525248 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-bfbb9b82-af75-4e18-981e-b725b696998c req-7b628bdc-bef3-4187-ab53-3313b10f06e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c933a35b-ab8d-4b24-ace9-75eec69b4f71", "name": "network-vif-plugged", "status": "completed", "tag": "748a7a21-04ad-4f5d-bec7-66ddae147215"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:35.526902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:35.526902 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:35:35.534676 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-bfbb9b82-af75-4e18-981e-b725b696998c req-7b628bdc-bef3-4187-ab53-3313b10f06e6 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:35.535127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-bfbb9b82-af75-4e18-981e-b725b696998c req-7b628bdc-bef3-4187-ab53-3313b10f06e6 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:35.547393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-bfbb9b82-af75-4e18-981e-b725b696998c req-7b628bdc-bef3-4187-ab53-3313b10f06e6 service nova] Creating event network-vif-plugged:748a7a21-04ad-4f5d-bec7-66ddae147215 for instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 on hv-cinder-80447 Feb 21 02:35:35.552119 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-bfbb9b82-af75-4e18-981e-b725b696998c req-7b628bdc-bef3-4187-ab53-3313b10f06e6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030592 Feb 21 02:35:35.553265 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 486/945] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:35.793620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ae9f81e6-e26c-4f3d-847a-7169ee6d2307 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:35.794258 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ae9f81e6-e26c-4f3d-847a-7169ee6d2307 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:35.799959 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ae9f81e6-e26c-4f3d-847a-7169ee6d2307 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:35.800409 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ae9f81e6-e26c-4f3d-847a-7169ee6d2307 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:35.801180 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ae9f81e6-e26c-4f3d-847a-7169ee6d2307 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:35.801661 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ae9f81e6-e26c-4f3d-847a-7169ee6d2307 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:35.936383 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ae9f81e6-e26c-4f3d-847a-7169ee6d2307 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:35.944211 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ae9f81e6-e26c-4f3d-847a-7169ee6d2307 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.154920 Feb 21 02:35:35.944771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 460/946] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:35 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:36.960769 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fb268daf-146d-4288-ae9e-6cad8a447e8f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:36.961468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fb268daf-146d-4288-ae9e-6cad8a447e8f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:36.967518 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fb268daf-146d-4288-ae9e-6cad8a447e8f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:36.967960 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fb268daf-146d-4288-ae9e-6cad8a447e8f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:36.968722 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fb268daf-146d-4288-ae9e-6cad8a447e8f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:36.969155 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fb268daf-146d-4288-ae9e-6cad8a447e8f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:37.103467 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fb268daf-146d-4288-ae9e-6cad8a447e8f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:37.110872 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fb268daf-146d-4288-ae9e-6cad8a447e8f tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1364 microversion: 2.1 time: 0.154552 Feb 21 02:35:37.111433 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 487/947] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:36 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:38.127542 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-14d1632b-95e0-4a3a-bc1a-bd77f753929b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:38.128146 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-14d1632b-95e0-4a3a-bc1a-bd77f753929b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:38.134915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-14d1632b-95e0-4a3a-bc1a-bd77f753929b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:38.135353 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-14d1632b-95e0-4a3a-bc1a-bd77f753929b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:38.136119 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-14d1632b-95e0-4a3a-bc1a-bd77f753929b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:38.136544 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-14d1632b-95e0-4a3a-bc1a-bd77f753929b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:38.267585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-14d1632b-95e0-4a3a-bc1a-bd77f753929b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:35:38.275219 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-14d1632b-95e0-4a3a-bc1a-bd77f753929b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1550 microversion: 2.1 time: 0.151350 Feb 21 02:35:38.275782 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 461/948] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:35:38 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:35:38.291743 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7c857d48-d104-44ec-b20f-230d4c07310b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:38.292257 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7c857d48-d104-44ec-b20f-230d4c07310b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:38.298469 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7c857d48-d104-44ec-b20f-230d4c07310b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:38.298915 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7c857d48-d104-44ec-b20f-230d4c07310b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:38.299692 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7c857d48-d104-44ec-b20f-230d4c07310b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:38.300111 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7c857d48-d104-44ec-b20f-230d4c07310b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:38.381436 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7c857d48-d104-44ec-b20f-230d4c07310b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093584 Feb 21 02:35:38.382068 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 488/949] 10.222.0.75 () {58 vars in 1274 bytes} [Mon Feb 21 02:35:38 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:35:39.564725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ffae3913-671c-4c90-9850-0ef94998152d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:39.565241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ffae3913-671c-4c90-9850-0ef94998152d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:39.567740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-98bdb761-9d3f-43bf-bdcb-437454a11373 req-29d8f14d-d5de-4653-8cb7-7a5a43acba87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c933a35b-ab8d-4b24-ace9-75eec69b4f71", "tag": "748a7a21-04ad-4f5d-bec7-66ddae147215"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:39.569282 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:35:39.569282 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:35:39.572632 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ffae3913-671c-4c90-9850-0ef94998152d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:39.572777 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ffae3913-671c-4c90-9850-0ef94998152d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:39.573624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ffae3913-671c-4c90-9850-0ef94998152d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:39.574219 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ffae3913-671c-4c90-9850-0ef94998152d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:39.576100 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-98bdb761-9d3f-43bf-bdcb-437454a11373 req-29d8f14d-d5de-4653-8cb7-7a5a43acba87 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:39.576550 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-98bdb761-9d3f-43bf-bdcb-437454a11373 req-29d8f14d-d5de-4653-8cb7-7a5a43acba87 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:39.587542 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-98bdb761-9d3f-43bf-bdcb-437454a11373 req-29d8f14d-d5de-4653-8cb7-7a5a43acba87 service nova] Creating event network-changed:748a7a21-04ad-4f5d-bec7-66ddae147215 for instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 on hv-cinder-80447 Feb 21 02:35:39.592541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-98bdb761-9d3f-43bf-bdcb-437454a11373 req-29d8f14d-d5de-4653-8cb7-7a5a43acba87 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029171 Feb 21 02:35:39.596777 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 489/950] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:39.598110 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ffae3913-671c-4c90-9850-0ef94998152d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/ips" status: 200 len: 106 microversion: 2.1 time: 0.037014 Feb 21 02:35:39.598686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 462/951] 10.222.0.75 () {58 vars in 1247 bytes} [Mon Feb 21 02:35:39 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/ips => generated 106 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:40.928443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e0455aec-e596-4039-ac6c-31d8f514ed37 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef591fa3-0e87-4d72-b02f-94a6438610e9"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:40.929567 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e0455aec-e596-4039-ac6c-31d8f514ed37 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:40.935572 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e0455aec-e596-4039-ac6c-31d8f514ed37 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:40.936019 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e0455aec-e596-4039-ac6c-31d8f514ed37 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:40.936781 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e0455aec-e596-4039-ac6c-31d8f514ed37 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:40.937210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e0455aec-e596-4039-ac6c-31d8f514ed37 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:41.163499 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e0455aec-e596-4039-ac6c-31d8f514ed37 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239307 Feb 21 02:35:41.164106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 490/952] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:35:40 2022] POST /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:48.621046 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-09b60994-22de-48bb-807e-dbfc9fa94920 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:48.622044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-09b60994-22de-48bb-807e-dbfc9fa94920 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:48.628406 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-09b60994-22de-48bb-807e-dbfc9fa94920 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:48.628859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-09b60994-22de-48bb-807e-dbfc9fa94920 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:48.629632 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-09b60994-22de-48bb-807e-dbfc9fa94920 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:48.630638 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-09b60994-22de-48bb-807e-dbfc9fa94920 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:48.660048 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-09b60994-22de-48bb-807e-dbfc9fa94920 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042615 Feb 21 02:35:48.660602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 463/953] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:35:48 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:48.671731 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-54cd7743-e87a-4d1f-9b80-e4acef5b9862 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:48.672306 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-54cd7743-e87a-4d1f-9b80-e4acef5b9862 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:48.679221 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-54cd7743-e87a-4d1f-9b80-e4acef5b9862 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:48.679664 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-54cd7743-e87a-4d1f-9b80-e4acef5b9862 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:48.680432 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-54cd7743-e87a-4d1f-9b80-e4acef5b9862 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:48.680863 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-54cd7743-e87a-4d1f-9b80-e4acef5b9862 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:48.708987 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-54cd7743-e87a-4d1f-9b80-e4acef5b9862 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/ef591fa3-0e87-4d72-b02f-94a6438610e9" status: 200 len: 194 microversion: 2.1 time: 0.041780 Feb 21 02:35:48.709552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 491/954] 10.222.0.75 () {58 vars in 1412 bytes} [Mon Feb 21 02:35:48 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/ef591fa3-0e87-4d72-b02f-94a6438610e9 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:50.033211 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f8e84ee0-d84e-4e27-85f8-2150ef6b7141 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b75e869-bc5a-4a56-9aec-be026bc23aac"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:35:50.034335 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f8e84ee0-d84e-4e27-85f8-2150ef6b7141 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:50.040233 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f8e84ee0-d84e-4e27-85f8-2150ef6b7141 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:50.040683 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f8e84ee0-d84e-4e27-85f8-2150ef6b7141 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:50.041463 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f8e84ee0-d84e-4e27-85f8-2150ef6b7141 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:50.041939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f8e84ee0-d84e-4e27-85f8-2150ef6b7141 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:50.275470 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f8e84ee0-d84e-4e27-85f8-2150ef6b7141 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "POST /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246092 Feb 21 02:35:50.276076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 464/955] 10.222.0.75 () {60 vars in 1322 bytes} [Mon Feb 21 02:35:50 2022] POST /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:35:57.735411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d02fc52c-e478-433e-93e2-2386cf6ac573 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:35:57.736407 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d02fc52c-e478-433e-93e2-2386cf6ac573 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:35:57.742728 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d02fc52c-e478-433e-93e2-2386cf6ac573 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:57.743201 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d02fc52c-e478-433e-93e2-2386cf6ac573 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:57.743965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d02fc52c-e478-433e-93e2-2386cf6ac573 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:35:57.744389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d02fc52c-e478-433e-93e2-2386cf6ac573 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:35:57.774417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d02fc52c-e478-433e-93e2-2386cf6ac573 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042952 Feb 21 02:35:57.774957 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 492/956] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:35:57 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:36:16.153500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-da935684-2fc8-443d-8717-157d504cd667 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:36:16.154685 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-da935684-2fc8-443d-8717-157d504cd667 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:16.161224 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-da935684-2fc8-443d-8717-157d504cd667 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:16.161736 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-da935684-2fc8-443d-8717-157d504cd667 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:16.162500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-da935684-2fc8-443d-8717-157d504cd667 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:16.162924 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-da935684-2fc8-443d-8717-157d504cd667 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:16.230875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-da935684-2fc8-443d-8717-157d504cd667 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "POST /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/action" status: 202 len: 0 microversion: 2.1 time: 0.081695 Feb 21 02:36:16.234391 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 465/957] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:36:16 2022] POST /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:36:16.240262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-699e7a92-50fc-4f50-90cf-ae8ef9c02dd0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:16.240878 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-699e7a92-50fc-4f50-90cf-ae8ef9c02dd0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:16.247617 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-699e7a92-50fc-4f50-90cf-ae8ef9c02dd0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:16.248145 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-699e7a92-50fc-4f50-90cf-ae8ef9c02dd0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:16.248926 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-699e7a92-50fc-4f50-90cf-ae8ef9c02dd0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:16.249364 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-699e7a92-50fc-4f50-90cf-ae8ef9c02dd0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:16.400936 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-699e7a92-50fc-4f50-90cf-ae8ef9c02dd0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:16.409139 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-699e7a92-50fc-4f50-90cf-ae8ef9c02dd0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1752 microversion: 2.1 time: 0.172728 Feb 21 02:36:16.410177 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 493/958] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:16 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:17.427883 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-888ccb3f-f919-4200-9fe5-819b7c219634 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:17.428568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-888ccb3f-f919-4200-9fe5-819b7c219634 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:17.434686 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-888ccb3f-f919-4200-9fe5-819b7c219634 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:17.435126 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-888ccb3f-f919-4200-9fe5-819b7c219634 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:17.435926 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-888ccb3f-f919-4200-9fe5-819b7c219634 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:17.436353 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-888ccb3f-f919-4200-9fe5-819b7c219634 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:17.584875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-888ccb3f-f919-4200-9fe5-819b7c219634 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:17.593195 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-888ccb3f-f919-4200-9fe5-819b7c219634 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.169807 Feb 21 02:36:17.593790 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 466/959] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:17 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:18.611565 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8c346528-3729-47a8-bc09-ee3f63073744 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:18.612164 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8c346528-3729-47a8-bc09-ee3f63073744 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:18.618880 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c346528-3729-47a8-bc09-ee3f63073744 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:18.619292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c346528-3729-47a8-bc09-ee3f63073744 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:18.620061 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c346528-3729-47a8-bc09-ee3f63073744 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:18.620542 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c346528-3729-47a8-bc09-ee3f63073744 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:18.766961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8c346528-3729-47a8-bc09-ee3f63073744 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:18.775295 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8c346528-3729-47a8-bc09-ee3f63073744 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.167780 Feb 21 02:36:18.775865 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 494/960] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:18 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:19.792081 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5853ad55-8750-4d26-9a0e-5e514c1000f6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:19.792681 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5853ad55-8750-4d26-9a0e-5e514c1000f6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:19.798905 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5853ad55-8750-4d26-9a0e-5e514c1000f6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:19.799367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5853ad55-8750-4d26-9a0e-5e514c1000f6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:19.800111 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5853ad55-8750-4d26-9a0e-5e514c1000f6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:19.800536 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5853ad55-8750-4d26-9a0e-5e514c1000f6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:20.092791 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5853ad55-8750-4d26-9a0e-5e514c1000f6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:20.101329 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5853ad55-8750-4d26-9a0e-5e514c1000f6 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.312908 Feb 21 02:36:20.101934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 467/961] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:19 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:21.119630 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b91201c9-a3fa-4138-8e43-4cbd2d3b87b3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:21.120234 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b91201c9-a3fa-4138-8e43-4cbd2d3b87b3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:21.126443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b91201c9-a3fa-4138-8e43-4cbd2d3b87b3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:21.126921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b91201c9-a3fa-4138-8e43-4cbd2d3b87b3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:21.127690 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b91201c9-a3fa-4138-8e43-4cbd2d3b87b3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:21.128124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b91201c9-a3fa-4138-8e43-4cbd2d3b87b3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:21.273279 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b91201c9-a3fa-4138-8e43-4cbd2d3b87b3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:21.280997 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b91201c9-a3fa-4138-8e43-4cbd2d3b87b3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.164984 Feb 21 02:36:21.281560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 495/962] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:21 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:22.297796 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b97123a9-2c87-45fa-b9ff-a2ccf8c66cb4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:22.298404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b97123a9-2c87-45fa-b9ff-a2ccf8c66cb4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:22.304702 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-2c87-45fa-b9ff-a2ccf8c66cb4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:22.305157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-2c87-45fa-b9ff-a2ccf8c66cb4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:22.305957 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-2c87-45fa-b9ff-a2ccf8c66cb4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:22.306398 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-2c87-45fa-b9ff-a2ccf8c66cb4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:22.452656 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b97123a9-2c87-45fa-b9ff-a2ccf8c66cb4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:22.461042 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b97123a9-2c87-45fa-b9ff-a2ccf8c66cb4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.166915 Feb 21 02:36:22.461600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 468/963] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:22 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:23.477928 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fbf1f7d8-4e44-4bf3-8c38-01702a60329b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:23.478534 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fbf1f7d8-4e44-4bf3-8c38-01702a60329b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:23.485027 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fbf1f7d8-4e44-4bf3-8c38-01702a60329b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:23.485471 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fbf1f7d8-4e44-4bf3-8c38-01702a60329b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:23.486262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fbf1f7d8-4e44-4bf3-8c38-01702a60329b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:23.486698 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fbf1f7d8-4e44-4bf3-8c38-01702a60329b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:23.635905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fbf1f7d8-4e44-4bf3-8c38-01702a60329b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:23.644103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fbf1f7d8-4e44-4bf3-8c38-01702a60329b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.169846 Feb 21 02:36:23.644680 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 496/964] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:23 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:24.662270 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-19d12bba-a91c-4049-9c1c-491d29ecc6f5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:24.662873 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-19d12bba-a91c-4049-9c1c-491d29ecc6f5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:24.668979 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-19d12bba-a91c-4049-9c1c-491d29ecc6f5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:24.669421 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-19d12bba-a91c-4049-9c1c-491d29ecc6f5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:24.670221 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-19d12bba-a91c-4049-9c1c-491d29ecc6f5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:24.670650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-19d12bba-a91c-4049-9c1c-491d29ecc6f5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:24.813794 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-19d12bba-a91c-4049-9c1c-491d29ecc6f5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:24.821622 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-19d12bba-a91c-4049-9c1c-491d29ecc6f5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.163666 Feb 21 02:36:24.822196 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 469/965] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:24 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:25.838673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2b2b24c2-7576-460f-8150-6b108646a89d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:25.839644 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2b2b24c2-7576-460f-8150-6b108646a89d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:25.846045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2b2b24c2-7576-460f-8150-6b108646a89d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:25.846491 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2b2b24c2-7576-460f-8150-6b108646a89d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:25.847254 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2b2b24c2-7576-460f-8150-6b108646a89d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:25.847685 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2b2b24c2-7576-460f-8150-6b108646a89d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:25.991654 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2b2b24c2-7576-460f-8150-6b108646a89d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:25.999436 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2b2b24c2-7576-460f-8150-6b108646a89d tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.164632 Feb 21 02:36:26.000008 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 497/966] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:25 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:36:27.016421 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c62c3b4b-cf82-47b8-bbf5-ebdc12ce68b0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:27.017009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c62c3b4b-cf82-47b8-bbf5-ebdc12ce68b0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:27.023542 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62c3b4b-cf82-47b8-bbf5-ebdc12ce68b0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:27.023987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62c3b4b-cf82-47b8-bbf5-ebdc12ce68b0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:27.024763 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62c3b4b-cf82-47b8-bbf5-ebdc12ce68b0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:27.025192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62c3b4b-cf82-47b8-bbf5-ebdc12ce68b0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:27.169807 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c62c3b4b-cf82-47b8-bbf5-ebdc12ce68b0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:27.178137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c62c3b4b-cf82-47b8-bbf5-ebdc12ce68b0 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1757 microversion: 2.1 time: 0.165363 Feb 21 02:36:27.178685 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 470/967] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:27 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:28.195666 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f081249a-5f5c-49c7-b0c8-9364d9b9adec tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:28.196426 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f081249a-5f5c-49c7-b0c8-9364d9b9adec tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:28.202741 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f081249a-5f5c-49c7-b0c8-9364d9b9adec tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:28.203190 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f081249a-5f5c-49c7-b0c8-9364d9b9adec tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:28.203962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f081249a-5f5c-49c7-b0c8-9364d9b9adec tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:28.204398 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f081249a-5f5c-49c7-b0c8-9364d9b9adec tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:28.346714 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f081249a-5f5c-49c7-b0c8-9364d9b9adec tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:28.354448 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f081249a-5f5c-49c7-b0c8-9364d9b9adec tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1760 microversion: 2.1 time: 0.163097 Feb 21 02:36:28.355010 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 498/968] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:36:28 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:45.623195 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f44e3095-5d7c-4a1f-96e1-548bf7cfc240 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:45.623748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f44e3095-5d7c-4a1f-96e1-548bf7cfc240 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:45.630200 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f44e3095-5d7c-4a1f-96e1-548bf7cfc240 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:45.630641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f44e3095-5d7c-4a1f-96e1-548bf7cfc240 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:45.631411 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f44e3095-5d7c-4a1f-96e1-548bf7cfc240 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:45.631835 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f44e3095-5d7c-4a1f-96e1-548bf7cfc240 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:45.659488 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f44e3095-5d7c-4a1f-96e1-548bf7cfc240 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments/1da3a24a-7f99-4102-8d72-e1cbe3d31204" status: 200 len: 194 microversion: 2.20 time: 0.133827 Feb 21 02:36:45.660069 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 471/969] 10.222.0.75 () {60 vars in 1453 bytes} [Mon Feb 21 02:36:45 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments/1da3a24a-7f99-4102-8d72-e1cbe3d31204 => generated 194 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:36:45.720148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c7bbc26b-a593-4411-922c-dcc3bec1a2b6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:45.720802 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c7bbc26b-a593-4411-922c-dcc3bec1a2b6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:45.727139 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c7bbc26b-a593-4411-922c-dcc3bec1a2b6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:45.727584 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c7bbc26b-a593-4411-922c-dcc3bec1a2b6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:45.728353 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c7bbc26b-a593-4411-922c-dcc3bec1a2b6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:45.728785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c7bbc26b-a593-4411-922c-dcc3bec1a2b6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:45.806954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-c7bbc26b-a593-4411-922c-dcc3bec1a2b6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lazy-loading 'services' on Instance uuid a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:36:45.874233 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c7bbc26b-a593-4411-922c-dcc3bec1a2b6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments/1da3a24a-7f99-4102-8d72-e1cbe3d31204" status: 202 len: 0 microversion: 2.20 time: 0.157566 Feb 21 02:36:45.874855 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 499/970] 10.222.0.75 () {60 vars in 1456 bytes} [Mon Feb 21 02:36:45 2022] DELETE /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments/1da3a24a-7f99-4102-8d72-e1cbe3d31204 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:36:45.883988 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6f3eedb9-4e09-4816-b4c2-734e9c4c6227 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:45.884942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6f3eedb9-4e09-4816-b4c2-734e9c4c6227 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:45.890892 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6f3eedb9-4e09-4816-b4c2-734e9c4c6227 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:45.891379 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6f3eedb9-4e09-4816-b4c2-734e9c4c6227 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:45.892242 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6f3eedb9-4e09-4816-b4c2-734e9c4c6227 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:45.892672 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6f3eedb9-4e09-4816-b4c2-734e9c4c6227 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:45.922664 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6f3eedb9-4e09-4816-b4c2-734e9c4c6227 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042341 Feb 21 02:36:45.923202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 472/971] 10.222.0.75 () {60 vars in 1342 bytes} [Mon Feb 21 02:36:45 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 02:36:46.936515 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c5bee78d-da32-49a3-8215-09de2e20dc0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:46.937577 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c5bee78d-da32-49a3-8215-09de2e20dc0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:46.944334 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c5bee78d-da32-49a3-8215-09de2e20dc0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:46.944780 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c5bee78d-da32-49a3-8215-09de2e20dc0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:46.945546 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c5bee78d-da32-49a3-8215-09de2e20dc0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:46.946002 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c5bee78d-da32-49a3-8215-09de2e20dc0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:46.974611 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c5bee78d-da32-49a3-8215-09de2e20dc0b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042676 Feb 21 02:36:46.975156 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 500/972] 10.222.0.75 () {60 vars in 1342 bytes} [Mon Feb 21 02:36:46 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:36:47.029166 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-605a1281-3a9d-458f-8f24-aa3a8905171c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:47.029661 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-605a1281-3a9d-458f-8f24-aa3a8905171c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:47.036000 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-605a1281-3a9d-458f-8f24-aa3a8905171c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:47.036440 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-605a1281-3a9d-458f-8f24-aa3a8905171c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:47.037207 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-605a1281-3a9d-458f-8f24-aa3a8905171c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:47.037635 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-605a1281-3a9d-458f-8f24-aa3a8905171c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:47.061374 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-605a1281-3a9d-458f-8f24-aa3a8905171c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:36:47.136869 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-605a1281-3a9d-458f-8f24-aa3a8905171c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 204 len: 0 microversion: 2.20 time: 0.110739 Feb 21 02:36:47.137541 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 473/973] 10.222.0.75 () {60 vars in 1279 bytes} [Mon Feb 21 02:36:47 2022] DELETE /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 02:36:47.146397 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:47.147010 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:47.152871 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:47.153313 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:47.154108 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:47.154541 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:47.290573 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:47.298314 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:47.299808 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:47.301551 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-bc10dc3a-bf45-433f-a028-46e0aadbdc4a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.159400 Feb 21 02:36:47.302142 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 501/974] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:47 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:36:48.320062 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:48.320742 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:48.327183 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:48.327629 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:48.328410 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:48.328840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:48.461382 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:48.468951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:48.470444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:48.471571 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b6a60117-4ffd-4a4a-8b61-8390bfecc49b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.156139 Feb 21 02:36:48.472122 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 474/975] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:48 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:36:49.490438 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:49.491111 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:49.497832 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:49.498282 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:49.499068 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:49.499509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:49.637819 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:49.646579 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:49.648058 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:49.649243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d0d89da0-bc0a-4df1-9646-10e78bc10770 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 200 len: 1725 microversion: 2.20 time: 0.162712 Feb 21 02:36:49.649819 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 502/976] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:49 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:36:49.884214 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-9057a705-03b4-4470-962c-8fc5541d2187 req-de62ae20-4359-4f80-8fb5-c9c5f1443c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b8e707-e1a8-46b8-8b47-ef1d9ef77903", "name": "network-vif-deleted", "tag": "186e3f15-c158-44f9-a144-358d5ab62c8f"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:36:49.885846 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:36:49.885846 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:36:49.898737 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-9057a705-03b4-4470-962c-8fc5541d2187 req-de62ae20-4359-4f80-8fb5-c9c5f1443c88 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:49.899209 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-9057a705-03b4-4470-962c-8fc5541d2187 req-de62ae20-4359-4f80-8fb5-c9c5f1443c88 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:49.911684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-9057a705-03b4-4470-962c-8fc5541d2187 req-de62ae20-4359-4f80-8fb5-c9c5f1443c88 service nova] Creating event network-vif-deleted:186e3f15-c158-44f9-a144-358d5ab62c8f for instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 on hv-cinder-80447 Feb 21 02:36:49.916598 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-9057a705-03b4-4470-962c-8fc5541d2187 req-de62ae20-4359-4f80-8fb5-c9c5f1443c88 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036096 Feb 21 02:36:49.917275 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 475/977] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:36:50.668232 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:50.668846 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:50.675616 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:50.676229 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:50.677032 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:50.677511 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:50.691973 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] HTTP exception thrown: Instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 could not be found. Feb 21 02:36:50.692571 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Returning 404 to user: Instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:36:50.693406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-be4429bc-b098-4eb2-8db2-fdf0c357b794 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 404 len: 111 microversion: 2.20 time: 0.028890 Feb 21 02:36:50.694015 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 503/978] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:50 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 21 02:36:50.702926 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-15e6c336-5317-4c25-bf51-6d9c90f4bc10 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '.version_select at 0x7fd857714160>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:50.727773 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-15e6c336-5317-4c25-bf51-6d9c90f4bc10 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674768771" status: 204 len: 0 microversion: 2.20 time: 0.028951 Feb 21 02:36:50.728367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 476/979] 10.222.0.75 () {60 vars in 1261 bytes} [Mon Feb 21 02:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1674768771 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 02:36:51.374115 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6f59f9e9-e6cb-4da9-9cba-95105b57b080 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'create', calling method: .version_select at 0x7fd85c10e0d0>, body: {"keypair": {"name": "tempest-keypair-1794736353"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:36:51.387888 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-6f59f9e9-e6cb-4da9-9cba-95105b57b080 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:36:51.391661 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-6f59f9e9-e6cb-4da9-9cba-95105b57b080 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for user fe4f394cc0a14d4e98d173a0f081bb8c and project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:36:51.487225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-6f59f9e9-e6cb-4da9-9cba-95105b57b080 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:36:51.492169 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-6f59f9e9-e6cb-4da9-9cba-95105b57b080 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for user fe4f394cc0a14d4e98d173a0f081bb8c and project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'key_pairs'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:36:51.504926 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6f59f9e9-e6cb-4da9-9cba-95105b57b080 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.134540 Feb 21 02:36:51.505520 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 504/980] 10.222.0.75 () {62 vars in 1198 bytes} [Mon Feb 21 02:36:51 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 21 02:36:52.677130 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2022587717", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aed7eff0-82e8-4eca-ade5-d5275418c168"}], "security_groups": [{"name": "tempest-securitygroup--1934202879"}], "key_name": "tempest-keypair-1794736353", "user_data": "}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:36:52.775721 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] validate_networks() for [('aed7eff0-82e8-4eca-ade5-d5275418c168', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:36:53.130955 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:36:53.131314 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:36:53.131804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:36:53.132202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:36:53.132602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:36:53.140930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:53.141370 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:53.142204 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:53.142631 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:53.158035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:36:53.162467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Getting quotas for user fe4f394cc0a14d4e98d173a0f081bb8c and project 6331fee47dce4e8b88574ea961f8b9a3. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:36:53.172751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:36:53.175104 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:36:53.220090 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d75c0249-ff45-4854-9858-137a2f545df6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.548094 Feb 21 02:36:53.220724 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 477/981] 10.222.0.75 () {62 vars in 1187 bytes} [Mon Feb 21 02:36:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 21 02:36:53.231950 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a236a5f9-f4d5-4936-adfc-d6368f1a86a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:53.232548 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a236a5f9-f4d5-4936-adfc-d6368f1a86a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:53.288937 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a236a5f9-f4d5-4936-adfc-d6368f1a86a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:53.297382 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a236a5f9-f4d5-4936-adfc-d6368f1a86a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:53.299190 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a236a5f9-f4d5-4936-adfc-d6368f1a86a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:53.300560 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a236a5f9-f4d5-4936-adfc-d6368f1a86a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1282 microversion: 2.20 time: 0.072525 Feb 21 02:36:53.301120 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 505/982] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:53 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:36:54.324690 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:54.325300 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:54.333398 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:54.333874 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:54.334661 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:54.335091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:54.617160 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:54.624779 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:54.626324 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:54.627662 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b5d88c31-cad9-4445-a709-4ad8471a4937 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1340 microversion: 2.20 time: 0.307115 Feb 21 02:36:54.628360 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 478/983] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:54 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1340 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:36:55.647570 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:55.649116 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:55.659731 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:55.660458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:55.661431 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:55.662054 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:55.668202 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-5616e4fc-5a3e-4e7f-a839-c0c747f2603e req-b98a2371-6cac-438f-8a3d-272b9e836f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0405d8a-efb9-44d0-a689-bf32224aefbc", "tag": "49c16a7e-5b17-4b9c-8fa6-77d95496d4b8"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:36:55.670550 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:36:55.670550 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:36:55.684155 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-5616e4fc-5a3e-4e7f-a839-c0c747f2603e req-b98a2371-6cac-438f-8a3d-272b9e836f49 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:55.684606 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-5616e4fc-5a3e-4e7f-a839-c0c747f2603e req-b98a2371-6cac-438f-8a3d-272b9e836f49 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:55.710801 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-5616e4fc-5a3e-4e7f-a839-c0c747f2603e req-b98a2371-6cac-438f-8a3d-272b9e836f49 service nova] Creating event network-changed:49c16a7e-5b17-4b9c-8fa6-77d95496d4b8 for instance c0405d8a-efb9-44d0-a689-bf32224aefbc on hv-cinder-80447 Feb 21 02:36:55.717403 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-5616e4fc-5a3e-4e7f-a839-c0c747f2603e req-b98a2371-6cac-438f-8a3d-272b9e836f49 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057504 Feb 21 02:36:55.718127 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 479/984] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:36:55.831070 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:55.839921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:55.841569 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:55.842894 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5e0fc25a-bc7d-4096-b792-bfd3d7188fcc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1408 microversion: 2.20 time: 0.200154 Feb 21 02:36:55.844412 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 506/985] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:55 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:36:56.864239 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:56.864876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:56.871253 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:56.871698 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:56.872461 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:56.872890 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:57.005417 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:57.013049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:57.014545 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:57.015633 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-54ea700f-098f-4c76-a546-28cae240a13f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1408 microversion: 2.20 time: 0.156629 Feb 21 02:36:57.016179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 480/986] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:56 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:36:58.033243 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:58.033874 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:58.040712 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:58.041157 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:58.041956 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:58.042391 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:58.170977 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:58.178948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:58.180429 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:58.181517 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e7f1e826-e6a4-488d-bee8-17d32bd37ba6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1408 microversion: 2.20 time: 0.151952 Feb 21 02:36:58.182110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 507/987] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:58 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:36:59.199910 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:36:59.200512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:36:59.207254 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:59.207733 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:59.208500 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:36:59.208930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:36:59.344381 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:59.352394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:59.353905 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:36:59.354999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ba8e5825-7c3b-4087-8073-d5febfa73a04 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1408 microversion: 2.20 time: 0.158812 Feb 21 02:36:59.355551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 481/988] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:36:59 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:37:00.373553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:00.374206 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:00.380998 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:00.381451 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:00.382262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:00.382705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:00.517338 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:00.525583 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:00.527073 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:00.528204 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-26f0d567-5661-4769-ae71-a0ea3234d350 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1408 microversion: 2.20 time: 0.158307 Feb 21 02:37:00.528705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 508/989] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:37:00 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:37:01.546351 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:01.546955 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:01.553192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:01.553631 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:01.554430 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:01.554859 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:01.685313 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:01.692954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:01.694434 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:01.695511 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-06cb0242-f518-4baa-b9fb-fdab7a706d7c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1408 microversion: 2.20 time: 0.153015 Feb 21 02:37:01.696059 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 482/990] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:37:01 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:37:01.880178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-9ae890b8-12c4-4975-b1e4-e22f48998b2b req-8353697c-92d8-42ed-979e-712dd6ab5d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0405d8a-efb9-44d0-a689-bf32224aefbc", "name": "network-vif-plugged", "status": "completed", "tag": "49c16a7e-5b17-4b9c-8fa6-77d95496d4b8"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:01.881962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:01.881962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:37:01.890006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-9ae890b8-12c4-4975-b1e4-e22f48998b2b req-8353697c-92d8-42ed-979e-712dd6ab5d59 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:01.890455 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-9ae890b8-12c4-4975-b1e4-e22f48998b2b req-8353697c-92d8-42ed-979e-712dd6ab5d59 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:01.902277 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-9ae890b8-12c4-4975-b1e4-e22f48998b2b req-8353697c-92d8-42ed-979e-712dd6ab5d59 service nova] Creating event network-vif-plugged:49c16a7e-5b17-4b9c-8fa6-77d95496d4b8 for instance c0405d8a-efb9-44d0-a689-bf32224aefbc on hv-cinder-80447 Feb 21 02:37:01.907356 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-9ae890b8-12c4-4975-b1e4-e22f48998b2b req-8353697c-92d8-42ed-979e-712dd6ab5d59 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031446 Feb 21 02:37:01.907953 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 509/991] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:02.712302 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:02.712907 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:02.719348 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:02.719799 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:02.720569 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:02.720996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:02.855879 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:02.864794 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:02.866304 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:02.867392 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0224d43d-0c41-4770-9321-bb38202e33a2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1408 microversion: 2.20 time: 0.158782 Feb 21 02:37:02.867954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 483/992] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:37:02 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:37:03.885821 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:03.886524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:03.892634 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:03.893107 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:03.894147 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:03.894734 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:04.024441 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:04.032240 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:04.033741 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:04.035083 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-64309178-440d-43df-95ca-d185b38a5793 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1601 microversion: 2.20 time: 0.153908 Feb 21 02:37:04.035652 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 510/993] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:37:03 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:37:04.052474 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6ef6e555-c872-4951-a590-a330e1d4b79b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:04.052980 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6ef6e555-c872-4951-a590-a330e1d4b79b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:04.059136 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6ef6e555-c872-4951-a590-a330e1d4b79b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:04.059607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6ef6e555-c872-4951-a590-a330e1d4b79b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:04.060372 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6ef6e555-c872-4951-a590-a330e1d4b79b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:04.060798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6ef6e555-c872-4951-a590-a330e1d4b79b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:04.142822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6ef6e555-c872-4951-a590-a330e1d4b79b tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094484 Feb 21 02:37:04.143415 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 484/994] 10.222.0.75 () {60 vars in 1315 bytes} [Mon Feb 21 02:37:04 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:37:05.087829 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8749d5fb-975c-488f-85a6-0473f0d378b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:05.088322 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8749d5fb-975c-488f-85a6-0473f0d378b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:05.090430 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-4e0dbd69-52d5-4800-9b94-5a87f05062e5 req-8ac524d7-42dc-4b1d-b3ee-8da5fe65c4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0405d8a-efb9-44d0-a689-bf32224aefbc", "tag": "49c16a7e-5b17-4b9c-8fa6-77d95496d4b8"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:05.092182 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:05.092182 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:37:05.094798 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8749d5fb-975c-488f-85a6-0473f0d378b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:05.095466 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8749d5fb-975c-488f-85a6-0473f0d378b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:05.097675 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8749d5fb-975c-488f-85a6-0473f0d378b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:05.098147 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8749d5fb-975c-488f-85a6-0473f0d378b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:05.100725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-4e0dbd69-52d5-4800-9b94-5a87f05062e5 req-8ac524d7-42dc-4b1d-b3ee-8da5fe65c4ec service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:05.101294 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-4e0dbd69-52d5-4800-9b94-5a87f05062e5 req-8ac524d7-42dc-4b1d-b3ee-8da5fe65c4ec service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:05.112725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-4e0dbd69-52d5-4800-9b94-5a87f05062e5 req-8ac524d7-42dc-4b1d-b3ee-8da5fe65c4ec service nova] Creating event network-changed:49c16a7e-5b17-4b9c-8fa6-77d95496d4b8 for instance c0405d8a-efb9-44d0-a689-bf32224aefbc on hv-cinder-80447 Feb 21 02:37:05.118457 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-4e0dbd69-52d5-4800-9b94-5a87f05062e5 req-8ac524d7-42dc-4b1d-b3ee-8da5fe65c4ec service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032013 Feb 21 02:37:05.119639 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 485/995] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:37:05.122819 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8749d5fb-975c-488f-85a6-0473f0d378b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/ips" status: 200 len: 113 microversion: 2.20 time: 0.039145 Feb 21 02:37:05.123391 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 511/996] 10.222.0.75 () {60 vars in 1288 bytes} [Mon Feb 21 02:37:05 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/ips => generated 113 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 02:37:09.866049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9c31883d-4e0f-45e1-80dc-c179590a13d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:09.866701 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9c31883d-4e0f-45e1-80dc-c179590a13d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:09.873909 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9c31883d-4e0f-45e1-80dc-c179590a13d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:09.874537 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9c31883d-4e0f-45e1-80dc-c179590a13d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:09.875519 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9c31883d-4e0f-45e1-80dc-c179590a13d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:09.876040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9c31883d-4e0f-45e1-80dc-c179590a13d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:09.910885 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9c31883d-4e0f-45e1-80dc-c179590a13d8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/ef591fa3-0e87-4d72-b02f-94a6438610e9" status: 200 len: 194 microversion: 2.1 time: 0.051367 Feb 21 02:37:09.911539 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 486/997] 10.222.0.75 () {58 vars in 1412 bytes} [Mon Feb 21 02:37:09 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/ef591fa3-0e87-4d72-b02f-94a6438610e9 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:09.921090 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a9cb74f6-db93-4abc-9d39-96312f67207b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:09.921623 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a9cb74f6-db93-4abc-9d39-96312f67207b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:09.928665 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a9cb74f6-db93-4abc-9d39-96312f67207b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:09.929107 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a9cb74f6-db93-4abc-9d39-96312f67207b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:09.929910 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a9cb74f6-db93-4abc-9d39-96312f67207b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:09.930340 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a9cb74f6-db93-4abc-9d39-96312f67207b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:10.006409 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-a9cb74f6-db93-4abc-9d39-96312f67207b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lazy-loading 'services' on Instance uuid c933a35b-ab8d-4b24-ace9-75eec69b4f71 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:37:10.073710 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a9cb74f6-db93-4abc-9d39-96312f67207b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/ef591fa3-0e87-4d72-b02f-94a6438610e9" status: 202 len: 0 microversion: 2.1 time: 0.156102 Feb 21 02:37:10.074289 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 512/998] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:37:09 2022] DELETE /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/ef591fa3-0e87-4d72-b02f-94a6438610e9 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:37:12.230691 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-79cd1054-ecfc-4b53-bd12-56bba7c35e72 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:12.231179 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-79cd1054-ecfc-4b53-bd12-56bba7c35e72 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:12.237617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-79cd1054-ecfc-4b53-bd12-56bba7c35e72 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:12.238092 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-79cd1054-ecfc-4b53-bd12-56bba7c35e72 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:12.238860 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-79cd1054-ecfc-4b53-bd12-56bba7c35e72 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:12.239293 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-79cd1054-ecfc-4b53-bd12-56bba7c35e72 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:12.266853 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-79cd1054-ecfc-4b53-bd12-56bba7c35e72 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/9b75e869-bc5a-4a56-9aec-be026bc23aac" status: 200 len: 194 microversion: 2.1 time: 0.040095 Feb 21 02:37:12.267413 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 487/999] 10.222.0.75 () {58 vars in 1412 bytes} [Mon Feb 21 02:37:12 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/9b75e869-bc5a-4a56-9aec-be026bc23aac => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:12.278599 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4af79f9c-f1bb-4bb9-ad69-2c4be1367a6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:12.279207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4af79f9c-f1bb-4bb9-ad69-2c4be1367a6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:12.286094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4af79f9c-f1bb-4bb9-ad69-2c4be1367a6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:12.286539 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4af79f9c-f1bb-4bb9-ad69-2c4be1367a6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:12.287318 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4af79f9c-f1bb-4bb9-ad69-2c4be1367a6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:12.287752 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4af79f9c-f1bb-4bb9-ad69-2c4be1367a6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:12.365826 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-4af79f9c-f1bb-4bb9-ad69-2c4be1367a6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lazy-loading 'services' on Instance uuid c933a35b-ab8d-4b24-ace9-75eec69b4f71 {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:37:12.431425 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4af79f9c-f1bb-4bb9-ad69-2c4be1367a6a tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/9b75e869-bc5a-4a56-9aec-be026bc23aac" status: 202 len: 0 microversion: 2.1 time: 0.157114 Feb 21 02:37:12.432213 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 513/1000] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:37:12 2022] DELETE /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments/9b75e869-bc5a-4a56-9aec-be026bc23aac => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:37:13.579425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c5c756b6-731b-41f2-9219-049dd3d9fb74 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:13.580326 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c5c756b6-731b-41f2-9219-049dd3d9fb74 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:13.587119 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c5c756b6-731b-41f2-9219-049dd3d9fb74 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:13.587562 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c5c756b6-731b-41f2-9219-049dd3d9fb74 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:13.588325 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c5c756b6-731b-41f2-9219-049dd3d9fb74 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:13.588753 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c5c756b6-731b-41f2-9219-049dd3d9fb74 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:13.616950 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c5c756b6-731b-41f2-9219-049dd3d9fb74 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041211 Feb 21 02:37:13.617505 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 488/1001] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:37:13 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 02:37:13.715437 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-80a74b50-5c22-408a-893f-35c9f8d875d4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:13.716492 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-80a74b50-5c22-408a-893f-35c9f8d875d4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:13.723397 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-80a74b50-5c22-408a-893f-35c9f8d875d4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:13.723845 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-80a74b50-5c22-408a-893f-35c9f8d875d4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:13.724613 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-80a74b50-5c22-408a-893f-35c9f8d875d4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:13.725045 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-80a74b50-5c22-408a-893f-35c9f8d875d4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:13.752437 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-80a74b50-5c22-408a-893f-35c9f8d875d4 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041001 Feb 21 02:37:13.753211 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 514/1002] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:37:13 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 02:37:13.807999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-3bf4eed5-496f-4d5a-91ef-6f39089d8534 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:13.808498 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3bf4eed5-496f-4d5a-91ef-6f39089d8534 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:13.822577 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3bf4eed5-496f-4d5a-91ef-6f39089d8534 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:13.823029 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3bf4eed5-496f-4d5a-91ef-6f39089d8534 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:13.823809 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3bf4eed5-496f-4d5a-91ef-6f39089d8534 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:13.824246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-3bf4eed5-496f-4d5a-91ef-6f39089d8534 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:13.855968 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-3bf4eed5-496f-4d5a-91ef-6f39089d8534 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:37:13.929221 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-3bf4eed5-496f-4d5a-91ef-6f39089d8534 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 204 len: 0 microversion: 2.1 time: 0.124520 Feb 21 02:37:13.929710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 489/1003] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:37:13 2022] DELETE /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:37:13.937586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c18e26d1-f102-4e92-9b23-a91b5f400dc2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:13.938228 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c18e26d1-f102-4e92-9b23-a91b5f400dc2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:13.944454 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c18e26d1-f102-4e92-9b23-a91b5f400dc2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:13.944903 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c18e26d1-f102-4e92-9b23-a91b5f400dc2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:13.945708 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c18e26d1-f102-4e92-9b23-a91b5f400dc2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:13.946141 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c18e26d1-f102-4e92-9b23-a91b5f400dc2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:14.076391 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c18e26d1-f102-4e92-9b23-a91b5f400dc2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:14.084392 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c18e26d1-f102-4e92-9b23-a91b5f400dc2 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1675 microversion: 2.1 time: 0.150454 Feb 21 02:37:14.084965 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 515/1004] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:13 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:37:15.101754 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-cfbb0185-0215-4d3e-a0fc-3c6523b4e62b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:15.102461 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-cfbb0185-0215-4d3e-a0fc-3c6523b4e62b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:15.108630 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cfbb0185-0215-4d3e-a0fc-3c6523b4e62b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:15.109106 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cfbb0185-0215-4d3e-a0fc-3c6523b4e62b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:15.110168 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cfbb0185-0215-4d3e-a0fc-3c6523b4e62b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:15.110600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-cfbb0185-0215-4d3e-a0fc-3c6523b4e62b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:15.243970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-cfbb0185-0215-4d3e-a0fc-3c6523b4e62b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:15.251137 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-cfbb0185-0215-4d3e-a0fc-3c6523b4e62b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1675 microversion: 2.1 time: 0.153498 Feb 21 02:37:15.251690 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 490/1005] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:15 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:16.269198 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-786c44c8-6eb0-4123-aa2c-4b292c677056 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:16.269849 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-786c44c8-6eb0-4123-aa2c-4b292c677056 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:16.276019 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-786c44c8-6eb0-4123-aa2c-4b292c677056 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:16.276495 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-786c44c8-6eb0-4123-aa2c-4b292c677056 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:16.277325 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-786c44c8-6eb0-4123-aa2c-4b292c677056 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:16.277772 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-786c44c8-6eb0-4123-aa2c-4b292c677056 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:16.414365 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-786c44c8-6eb0-4123-aa2c-4b292c677056 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:16.421743 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-786c44c8-6eb0-4123-aa2c-4b292c677056 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1675 microversion: 2.1 time: 0.157030 Feb 21 02:37:16.422304 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 516/1006] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:16 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:17.439447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b1c0fd30-4401-4cbd-b469-a2fc6e22384b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:17.440053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b1c0fd30-4401-4cbd-b469-a2fc6e22384b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:17.446730 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1c0fd30-4401-4cbd-b469-a2fc6e22384b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:17.447173 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1c0fd30-4401-4cbd-b469-a2fc6e22384b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:17.447952 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1c0fd30-4401-4cbd-b469-a2fc6e22384b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:17.448384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1c0fd30-4401-4cbd-b469-a2fc6e22384b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:17.526767 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-b1c0fd30-4401-4cbd-b469-a2fc6e22384b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30239e42418b4e33bdc1b9fb30b45004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e923a4cc944b28979de727cb5269d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:17.534748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b1c0fd30-4401-4cbd-b469-a2fc6e22384b tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 200 len: 1607 microversion: 2.1 time: 0.098522 Feb 21 02:37:17.535334 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 491/1007] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:17 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 1607 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:17.944087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-b5de772d-f340-463e-ab66-a39baebc04ef req-49ce5a37-c04e-421c-b388-07500c72bd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c933a35b-ab8d-4b24-ace9-75eec69b4f71", "name": "network-vif-deleted", "tag": "748a7a21-04ad-4f5d-bec7-66ddae147215"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:17.946442 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:17.946442 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:37:17.966749 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-b5de772d-f340-463e-ab66-a39baebc04ef req-49ce5a37-c04e-421c-b388-07500c72bd68 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:17.970755 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-b5de772d-f340-463e-ab66-a39baebc04ef req-49ce5a37-c04e-421c-b388-07500c72bd68 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:17.996480 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2e02dc4c-5759-4482-a108-562faeb1b895 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:17.996983 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2e02dc4c-5759-4482-a108-562faeb1b895 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:18.000868 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-b5de772d-f340-463e-ab66-a39baebc04ef req-49ce5a37-c04e-421c-b388-07500c72bd68 service nova] Creating event network-vif-deleted:748a7a21-04ad-4f5d-bec7-66ddae147215 for instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 on hv-cinder-80447 Feb 21 02:37:18.006420 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2e02dc4c-5759-4482-a108-562faeb1b895 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:18.007121 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2e02dc4c-5759-4482-a108-562faeb1b895 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:18.008415 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2e02dc4c-5759-4482-a108-562faeb1b895 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:18.009108 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2e02dc4c-5759-4482-a108-562faeb1b895 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:18.009922 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-b5de772d-f340-463e-ab66-a39baebc04ef req-49ce5a37-c04e-421c-b388-07500c72bd68 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071537 Feb 21 02:37:18.010889 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 517/1008] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:18.036235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2e02dc4c-5759-4482-a108-562faeb1b895 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:37:18.131448 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2e02dc4c-5759-4482-a108-562faeb1b895 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "DELETE /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 204 len: 0 microversion: 2.1 time: 0.139136 Feb 21 02:37:18.133509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 492/1009] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:37:17 2022] DELETE /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:37:18.142987 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8c8a636a-92fc-4b3f-b2df-e0b86dd8be1d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:18.144300 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8c8a636a-92fc-4b3f-b2df-e0b86dd8be1d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:18.150460 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c8a636a-92fc-4b3f-b2df-e0b86dd8be1d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:18.150904 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c8a636a-92fc-4b3f-b2df-e0b86dd8be1d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:18.151680 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c8a636a-92fc-4b3f-b2df-e0b86dd8be1d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:18.152110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c8a636a-92fc-4b3f-b2df-e0b86dd8be1d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:18.290212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8c8a636a-92fc-4b3f-b2df-e0b86dd8be1d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:18.298106 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8c8a636a-92fc-4b3f-b2df-e0b86dd8be1d tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.159933 Feb 21 02:37:18.298678 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 518/1010] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:18 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:18.553230 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:18.557368 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:18.567304 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:18.567756 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:18.568549 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:18.568996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:18.583937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] HTTP exception thrown: Instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 could not be found. Feb 21 02:37:18.584694 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Returning 404 to user: Instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:37:18.585732 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7c33cfa4-6f79-47ad-b352-4b549c7d6608 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 404 len: 111 microversion: 2.1 time: 0.037213 Feb 21 02:37:18.586284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 493/1011] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:18 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:37:18.595884 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b63381ba-7369-48a0-8962-ab1e1a6f6b85 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '.version_select at 0x7fd85c0b4f70>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:18.616801 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b63381ba-7369-48a0-8962-ab1e1a6f6b85 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054968600" status: 202 len: 0 microversion: 2.1 time: 0.025111 Feb 21 02:37:18.617509 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 519/1012] 10.222.0.75 () {58 vars in 1220 bytes} [Mon Feb 21 02:37:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054968600 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:37:19.316724 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-442c699b-9afb-4ef9-9253-18927501a8c3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:19.317455 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-442c699b-9afb-4ef9-9253-18927501a8c3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:19.323386 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-442c699b-9afb-4ef9-9253-18927501a8c3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:19.323915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-442c699b-9afb-4ef9-9253-18927501a8c3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:19.324772 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-442c699b-9afb-4ef9-9253-18927501a8c3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:19.325300 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-442c699b-9afb-4ef9-9253-18927501a8c3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:19.464774 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-442c699b-9afb-4ef9-9253-18927501a8c3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:19.472487 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-442c699b-9afb-4ef9-9253-18927501a8c3 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1568 microversion: 2.1 time: 0.160480 Feb 21 02:37:19.473048 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 494/1013] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:19 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:20.035989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-d56e35d4-498e-4a7b-884d-8c8f7c8b5dc8 req-b094a041-9936-4f2b-a8a1-de2c4b7b52b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28fd287f-356c-4485-ba82-bbe3da3cf5ba", "tag": "212cff7d-b04b-4efb-be92-6dd1bd6ec779"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:20.037477 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:20.037477 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:37:20.045212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-d56e35d4-498e-4a7b-884d-8c8f7c8b5dc8 req-b094a041-9936-4f2b-a8a1-de2c4b7b52b3 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:20.045662 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-d56e35d4-498e-4a7b-884d-8c8f7c8b5dc8 req-b094a041-9936-4f2b-a8a1-de2c4b7b52b3 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:20.055966 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-d56e35d4-498e-4a7b-884d-8c8f7c8b5dc8 req-b094a041-9936-4f2b-a8a1-de2c4b7b52b3 service nova] Creating event network-changed:212cff7d-b04b-4efb-be92-6dd1bd6ec779 for instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba on hv-cinder-80447 Feb 21 02:37:20.060989 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-d56e35d4-498e-4a7b-884d-8c8f7c8b5dc8 req-b094a041-9936-4f2b-a8a1-de2c4b7b52b3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028536 Feb 21 02:37:20.061496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 520/1014] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:20.491181 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-35132429-0130-43db-96a9-6a8a43784214 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:20.491981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-35132429-0130-43db-96a9-6a8a43784214 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:20.500374 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-35132429-0130-43db-96a9-6a8a43784214 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:20.500932 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-35132429-0130-43db-96a9-6a8a43784214 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:20.502153 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-35132429-0130-43db-96a9-6a8a43784214 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:20.505031 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-35132429-0130-43db-96a9-6a8a43784214 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:20.603822 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-35132429-0130-43db-96a9-6a8a43784214 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4941ffa30a3740608a9d46b546ba6f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c955ce069224b53aa944c7971e3650c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:20.611421 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-35132429-0130-43db-96a9-6a8a43784214 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 200 len: 1500 microversion: 2.1 time: 0.125465 Feb 21 02:37:20.612684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 495/1015] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:20 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 1500 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:21.552335 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:21.552928 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:21.559017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:21.559417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:21.560218 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:21.561153 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:21.574671 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] HTTP exception thrown: Instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 could not be found. Feb 21 02:37:21.575253 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Returning 404 to user: Instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:37:21.576065 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f2829545-87c3-4e97-8a7a-c49b6a8f6651 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 404 len: 111 microversion: 2.1 time: 0.028270 Feb 21 02:37:21.576600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 521/1016] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:37:21 2022] DELETE /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:37:21.584808 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:21.585419 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: c933a35b-ab8d-4b24-ace9-75eec69b4f71] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:21.591649 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:21.592102 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:21.592874 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:21.593307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:21.606369 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] HTTP exception thrown: Instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 could not be found. Feb 21 02:37:21.606954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Returning 404 to user: Instance c933a35b-ab8d-4b24-ace9-75eec69b4f71 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:37:21.607750 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-81682bf1-0b23-497c-82a9-aba229f6cf2d tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71" status: 404 len: 111 microversion: 2.1 time: 0.027205 Feb 21 02:37:21.608263 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 496/1017] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:21 2022] GET /compute/v2.1/servers/c933a35b-ab8d-4b24-ace9-75eec69b4f71 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:37:21.628297 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:21.628898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] [instance: 28fd287f-356c-4485-ba82-bbe3da3cf5ba] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:21.634698 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:21.635149 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:21.635926 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:21.636363 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:21.651202 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] HTTP exception thrown: Instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba could not be found. Feb 21 02:37:21.651782 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Returning 404 to user: Instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:37:21.652601 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b0eae274-b52f-493d-816e-a9b4caa4bf04 tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba" status: 404 len: 111 microversion: 2.1 time: 0.028406 Feb 21 02:37:21.653159 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 522/1018] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:21 2022] GET /compute/v2.1/servers/28fd287f-356c-4485-ba82-bbe3da3cf5ba => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:37:21.812777 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7fbe420b-bc93-4a79-8d0b-375765724b5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] Calling method '.version_select at 0x7fd857780ca0>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:21.838017 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7fbe420b-bc93-4a79-8d0b-375765724b5c tempest-TestShelveInstance-2009678502 tempest-TestShelveInstance-2009678502-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1832202538" status: 202 len: 0 microversion: 2.1 time: 0.028847 Feb 21 02:37:21.838943 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 497/1019] 10.222.0.75 () {58 vars in 1253 bytes} [Mon Feb 21 02:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1832202538 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:37:22.077764 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-83f3f5b8-ab18-4d79-a7b0-4141f8779658 req-40afa5aa-881d-4f6b-822e-991476ba2ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fd287f-356c-4485-ba82-bbe3da3cf5ba", "name": "network-vif-deleted", "tag": "212cff7d-b04b-4efb-be92-6dd1bd6ec779"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:22.079264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:22.079264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:37:22.086904 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-83f3f5b8-ab18-4d79-a7b0-4141f8779658 req-40afa5aa-881d-4f6b-822e-991476ba2ce5 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:22.087349 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-83f3f5b8-ab18-4d79-a7b0-4141f8779658 req-40afa5aa-881d-4f6b-822e-991476ba2ce5 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:22.098415 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-83f3f5b8-ab18-4d79-a7b0-4141f8779658 req-40afa5aa-881d-4f6b-822e-991476ba2ce5 service nova] Creating event network-vif-deleted:212cff7d-b04b-4efb-be92-6dd1bd6ec779 for instance 28fd287f-356c-4485-ba82-bbe3da3cf5ba on hv-cinder-80447 Feb 21 02:37:22.103199 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-83f3f5b8-ab18-4d79-a7b0-4141f8779658 req-40afa5aa-881d-4f6b-822e-991476ba2ce5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029152 Feb 21 02:37:22.103783 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 523/1020] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:22.737250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:22.737909 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:22.743568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:22.744017 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:22.744791 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:22.745222 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:22.758924 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] HTTP exception thrown: Instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c could not be found. Feb 21 02:37:22.759502 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Returning 404 to user: Instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:37:22.760319 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-b1bea5dc-0e3f-429b-ab8f-ef9cba6d9ea8 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 404 len: 111 microversion: 2.1 time: 0.027599 Feb 21 02:37:22.760847 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 498/1021] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:37:22 2022] DELETE /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:37:22.770632 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:22.771426 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] [instance: 2af65eb3-dbe6-4a66-919e-c8a6884b613c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:22.777700 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:22.778178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:22.778970 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:22.779442 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:22.793269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] HTTP exception thrown: Instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c could not be found. Feb 21 02:37:22.793871 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] Returning 404 to user: Instance 2af65eb3-dbe6-4a66-919e-c8a6884b613c could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:37:22.794697 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7da45689-52c9-4901-9ef7-e9ec6016eae1 tempest-AttachVolumeTestJSON-542092255 tempest-AttachVolumeTestJSON-542092255-project] 10.222.0.75 "GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c" status: 404 len: 111 microversion: 2.1 time: 0.029576 Feb 21 02:37:22.795224 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 524/1022] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:22 2022] GET /compute/v2.1/servers/2af65eb3-dbe6-4a66-919e-c8a6884b613c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:37:28.624571 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0f260327-ee39-47b2-b082-334ac99d1e13 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-867262286"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:28.625828 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0f260327-ee39-47b2-b082-334ac99d1e13 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:28.635307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0f260327-ee39-47b2-b082-334ac99d1e13 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:28.636162 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0f260327-ee39-47b2-b082-334ac99d1e13 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:28.637195 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0f260327-ee39-47b2-b082-334ac99d1e13 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:28.637875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0f260327-ee39-47b2-b082-334ac99d1e13 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:28.833322 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.network.security_group_api [None req-0f260327-ee39-47b2-b082-334ac99d1e13 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Removing security group 6d986f78-46d0-4b70-8b8d-7cb5af1e43c6 from port ae827098-b4d8-4d85-b652-12a13456ab7e Feb 21 02:37:29.380996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0f260327-ee39-47b2-b082-334ac99d1e13 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "POST /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/action" status: 202 len: 0 microversion: 2.1 time: 0.760230 Feb 21 02:37:29.381847 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 499/1023] 10.222.0.75 () {60 vars in 1277 bytes} [Mon Feb 21 02:37:28 2022] POST /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/action => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:37:29.392005 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-fdeab1a1-06e5-42ae-acdb-42ee63932afe req-e78e3654-9560-4210-a9cb-7a7d2db7ed23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba884d36-ccad-4dd6-8135-6f7bfc55077c", "tag": "ae827098-b4d8-4d85-b652-12a13456ab7e"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:29.394675 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:29.394675 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:37:29.412633 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-fdeab1a1-06e5-42ae-acdb-42ee63932afe req-e78e3654-9560-4210-a9cb-7a7d2db7ed23 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:29.413149 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-fdeab1a1-06e5-42ae-acdb-42ee63932afe req-e78e3654-9560-4210-a9cb-7a7d2db7ed23 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:29.443083 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-fdeab1a1-06e5-42ae-acdb-42ee63932afe req-e78e3654-9560-4210-a9cb-7a7d2db7ed23 service nova] Creating event network-changed:ae827098-b4d8-4d85-b652-12a13456ab7e for instance ba884d36-ccad-4dd6-8135-6f7bfc55077c on hv-cinder-80447 Feb 21 02:37:29.449110 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-fdeab1a1-06e5-42ae-acdb-42ee63932afe req-e78e3654-9560-4210-a9cb-7a7d2db7ed23 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063314 Feb 21 02:37:29.460652 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 525/1024] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:37:31.013533 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c40a4bf5-7b8c-4cf7-a914-279e03a62a86 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:31.015099 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c40a4bf5-7b8c-4cf7-a914-279e03a62a86 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:31.022112 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c40a4bf5-7b8c-4cf7-a914-279e03a62a86 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:31.022900 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c40a4bf5-7b8c-4cf7-a914-279e03a62a86 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:31.023245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-4bcecf5e-b91f-4fd4-a550-83e67ba3aa4e req-deeeef3a-a5e1-46b1-ba85-9193093f6b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba884d36-ccad-4dd6-8135-6f7bfc55077c", "tag": "ae827098-b4d8-4d85-b652-12a13456ab7e"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:31.024069 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c40a4bf5-7b8c-4cf7-a914-279e03a62a86 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:31.024720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c40a4bf5-7b8c-4cf7-a914-279e03a62a86 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:31.024835 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:31.024835 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:37:31.043505 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-4bcecf5e-b91f-4fd4-a550-83e67ba3aa4e req-deeeef3a-a5e1-46b1-ba85-9193093f6b9b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:31.044269 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-4bcecf5e-b91f-4fd4-a550-83e67ba3aa4e req-deeeef3a-a5e1-46b1-ba85-9193093f6b9b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:31.059934 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-4bcecf5e-b91f-4fd4-a550-83e67ba3aa4e req-deeeef3a-a5e1-46b1-ba85-9193093f6b9b service nova] Creating event network-changed:ae827098-b4d8-4d85-b652-12a13456ab7e for instance ba884d36-ccad-4dd6-8135-6f7bfc55077c on hv-cinder-80447 Feb 21 02:37:31.066169 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-4bcecf5e-b91f-4fd4-a550-83e67ba3aa4e req-deeeef3a-a5e1-46b1-ba85-9193093f6b9b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047040 Feb 21 02:37:31.067144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 526/1025] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:31.112042 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-c40a4bf5-7b8c-4cf7-a914-279e03a62a86 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lazy-loading 'services' on Instance uuid ba884d36-ccad-4dd6-8135-6f7bfc55077c {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:37:31.183344 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c40a4bf5-7b8c-4cf7-a914-279e03a62a86 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments/d235de4f-be2b-4d67-a160-7bcbc5319bfc" status: 202 len: 0 microversion: 2.1 time: 0.173395 Feb 21 02:37:31.187226 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 500/1026] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:37:31 2022] DELETE /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments/d235de4f-be2b-4d67-a160-7bcbc5319bfc => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:37:31.193024 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c8d67fc9-eb7f-44b1-abf9-783cac9f022f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:31.194039 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c8d67fc9-eb7f-44b1-abf9-783cac9f022f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:31.200330 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c8d67fc9-eb7f-44b1-abf9-783cac9f022f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:31.200993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c8d67fc9-eb7f-44b1-abf9-783cac9f022f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:31.201953 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c8d67fc9-eb7f-44b1-abf9-783cac9f022f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:31.202607 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c8d67fc9-eb7f-44b1-abf9-783cac9f022f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:31.238932 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c8d67fc9-eb7f-44b1-abf9-783cac9f022f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049924 Feb 21 02:37:31.241733 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 527/1027] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:37:31 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:32.198086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:37:32.198702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: Mon Feb 21 02:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:37:32.252813 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5df87284-fa00-4bdb-9b52-62df8b3188a3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:32.253901 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5df87284-fa00-4bdb-9b52-62df8b3188a3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:32.259954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5df87284-fa00-4bdb-9b52-62df8b3188a3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:32.260386 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5df87284-fa00-4bdb-9b52-62df8b3188a3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:32.261163 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5df87284-fa00-4bdb-9b52-62df8b3188a3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:32.261586 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5df87284-fa00-4bdb-9b52-62df8b3188a3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:32.291089 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5df87284-fa00-4bdb-9b52-62df8b3188a3 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Feb 21 02:37:32.291579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 501/1028] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:37:32 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:33.303459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-44f35559-f7ae-4ac1-a8d7-8ba1fbd57918 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:33.304603 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-44f35559-f7ae-4ac1-a8d7-8ba1fbd57918 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:33.311591 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-44f35559-f7ae-4ac1-a8d7-8ba1fbd57918 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:33.312047 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-44f35559-f7ae-4ac1-a8d7-8ba1fbd57918 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:33.312839 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-44f35559-f7ae-4ac1-a8d7-8ba1fbd57918 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:33.313280 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-44f35559-f7ae-4ac1-a8d7-8ba1fbd57918 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:33.343017 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-44f35559-f7ae-4ac1-a8d7-8ba1fbd57918 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Feb 21 02:37:33.343571 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 528/1029] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:37:33 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:34.354596 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-67cda74b-440d-434e-831c-5d4ac44a7ac5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:34.355510 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-67cda74b-440d-434e-831c-5d4ac44a7ac5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:34.362723 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-67cda74b-440d-434e-831c-5d4ac44a7ac5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:34.363178 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-67cda74b-440d-434e-831c-5d4ac44a7ac5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:34.363961 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-67cda74b-440d-434e-831c-5d4ac44a7ac5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:34.364400 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-67cda74b-440d-434e-831c-5d4ac44a7ac5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:34.393617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-67cda74b-440d-434e-831c-5d4ac44a7ac5 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042721 Feb 21 02:37:34.394192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 502/1030] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:37:34 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:35.404199 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b0686cd6-e1a3-4cd8-9bc1-da3e2c7bc6ff tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:35.405109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b0686cd6-e1a3-4cd8-9bc1-da3e2c7bc6ff tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:35.411616 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0686cd6-e1a3-4cd8-9bc1-da3e2c7bc6ff tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:35.412103 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0686cd6-e1a3-4cd8-9bc1-da3e2c7bc6ff tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:35.412835 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0686cd6-e1a3-4cd8-9bc1-da3e2c7bc6ff tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:35.413270 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b0686cd6-e1a3-4cd8-9bc1-da3e2c7bc6ff tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:35.443480 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b0686cd6-e1a3-4cd8-9bc1-da3e2c7bc6ff tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042983 Feb 21 02:37:35.444041 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 529/1031] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:37:35 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:36.123057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-636628910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-72472954", "security_groups": [{"name": "tempest-secgroup-smoke-1444044047"}], "block_device_mapping_v2": [{"uuid": "a6e0a7f6-1d47-40b7-a584-fee67d63ed79", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c5e55e19-0047-4adf-9d84-20427890cdd2"}]}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:36.230222 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.network.neutron [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] validate_networks() for [('c5e55e19-0047-4adf-9d84-20427890cdd2', None, None, None, None, None)] {{(pid=116710) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:37:36.454626 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-85c98453-740a-40fc-966e-2d5595c03502 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:36.455843 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-85c98453-740a-40fc-966e-2d5595c03502 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:36.461990 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85c98453-740a-40fc-966e-2d5595c03502 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:36.462434 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85c98453-740a-40fc-966e-2d5595c03502 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:36.463202 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85c98453-740a-40fc-966e-2d5595c03502 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:36.463630 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-85c98453-740a-40fc-966e-2d5595c03502 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:36.492691 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-85c98453-740a-40fc-966e-2d5595c03502 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041643 Feb 21 02:37:36.493176 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 530/1032] 10.222.0.75 () {58 vars in 1301 bytes} [Mon Feb 21 02:37:36 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 02:37:36.502439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:36.502924 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:36.508505 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:36.508950 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:36.509758 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:36.510196 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:36.581450 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] HTTP exception thrown: Instance ba884d36-ccad-4dd6-8135-6f7bfc55077c is not attached to volume d235de4f-be2b-4d67-a160-7bcbc5319bfc Feb 21 02:37:36.582075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Returning 404 to user: Instance ba884d36-ccad-4dd6-8135-6f7bfc55077c is not attached to volume d235de4f-be2b-4d67-a160-7bcbc5319bfc {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:37:36.582909 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8dfc89d8-ffe2-4241-98c9-9d8f2937a34f tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments/d235de4f-be2b-4d67-a160-7bcbc5319bfc" status: 404 len: 154 microversion: 2.1 time: 0.084206 Feb 21 02:37:36.583617 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 531/1033] 10.222.0.75 () {58 vars in 1415 bytes} [Mon Feb 21 02:37:36 2022] DELETE /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c/os-volume_attachments/d235de4f-be2b-4d67-a160-7bcbc5319bfc => generated 154 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 02:37:36.612339 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Flavor limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:37:36.612762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Image limits 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:37:36.613210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Flavor pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:37:36.613605 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Image pref 0:0:0 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:37:36.614027 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.virt.hardware [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116710) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:37:36.622610 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:36.623024 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:36.623820 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:36.624244 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:36.640546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for project 9d0c19115c1746f1956552777cc35baf. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:37:36.644636 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.quota [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Getting quotas for user 9e81057507d24a2ca8f7b57eef422397 and project 9d0c19115c1746f1956552777cc35baf. Resources: {'ram', 'cores', 'instances'} {{(pid=116710) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:37:36.698969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Going to run 1 instances... {{(pid=116710) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:37:36.701059 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6e0a7f6-1d47-40b7-a584-fee67d63ed79',volume_size=None,volume_type=None)] {{(pid=116710) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:37:36.823039 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ed31ab0a-68ed-4136-8fc7-5fcaf5e1090b tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703378 Feb 21 02:37:36.823680 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 503/1034] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:37:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:37:36.833793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-7a270a90-bed8-4aab-9408-76464b9c97b0 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:36.834400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-7a270a90-bed8-4aab-9408-76464b9c97b0 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:36.890265 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-7a270a90-bed8-4aab-9408-76464b9c97b0 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:36.899207 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-7a270a90-bed8-4aab-9408-76464b9c97b0 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1092 microversion: 2.1 time: 0.069490 Feb 21 02:37:36.899762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 532/1035] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:36 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1092 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:37.916037 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-388e8e63-a042-42ef-8565-01e6b7939c74 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:37.916644 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-388e8e63-a042-42ef-8565-01e6b7939c74 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:37.924398 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-388e8e63-a042-42ef-8565-01e6b7939c74 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:37.924842 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-388e8e63-a042-42ef-8565-01e6b7939c74 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:37.925617 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-388e8e63-a042-42ef-8565-01e6b7939c74 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:37.926102 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-388e8e63-a042-42ef-8565-01e6b7939c74 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:37.983897 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-388e8e63-a042-42ef-8565-01e6b7939c74 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:37.991999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-388e8e63-a042-42ef-8565-01e6b7939c74 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1142 microversion: 2.1 time: 0.079569 Feb 21 02:37:37.992553 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 504/1036] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:37 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1142 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:39.008822 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-72ee283c-5145-4b10-bd34-27da07b19fff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:39.009356 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-72ee283c-5145-4b10-bd34-27da07b19fff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:39.015584 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-72ee283c-5145-4b10-bd34-27da07b19fff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:39.016040 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-72ee283c-5145-4b10-bd34-27da07b19fff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:39.016810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-72ee283c-5145-4b10-bd34-27da07b19fff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:39.017271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-72ee283c-5145-4b10-bd34-27da07b19fff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:39.075552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-72ee283c-5145-4b10-bd34-27da07b19fff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:39.082858 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-72ee283c-5145-4b10-bd34-27da07b19fff tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1134 microversion: 2.1 time: 0.077768 Feb 21 02:37:39.083413 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 533/1037] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:39 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1134 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:37:40.101006 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e731a360-03b4-4f09-8fe0-63da56c239e6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:40.101798 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e731a360-03b4-4f09-8fe0-63da56c239e6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:40.108177 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e731a360-03b4-4f09-8fe0-63da56c239e6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:40.108624 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e731a360-03b4-4f09-8fe0-63da56c239e6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:40.109399 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e731a360-03b4-4f09-8fe0-63da56c239e6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:40.110121 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e731a360-03b4-4f09-8fe0-63da56c239e6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:40.174571 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e731a360-03b4-4f09-8fe0-63da56c239e6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:40.182176 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e731a360-03b4-4f09-8fe0-63da56c239e6 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1190 microversion: 2.1 time: 0.086287 Feb 21 02:37:40.182737 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 505/1038] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:40 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1190 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:41.200910 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-261475a8-a688-43f4-a354-7f11d95334cf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:41.202465 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-261475a8-a688-43f4-a354-7f11d95334cf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:41.210626 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-261475a8-a688-43f4-a354-7f11d95334cf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:41.211292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-261475a8-a688-43f4-a354-7f11d95334cf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:41.212324 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-261475a8-a688-43f4-a354-7f11d95334cf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:41.212923 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-261475a8-a688-43f4-a354-7f11d95334cf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:41.386600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-261475a8-a688-43f4-a354-7f11d95334cf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:41.395093 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-261475a8-a688-43f4-a354-7f11d95334cf tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1276 microversion: 2.1 time: 0.199394 Feb 21 02:37:41.406860 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 534/1039] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:41 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:41.627585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-e8dd85a2-faad-42d7-8989-63190fb0a244 req-207ca29f-b80a-4838-a0c9-674a7b49b0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c26b82-838e-4a45-9728-070472b9798d", "tag": "74031657-e31e-49d9-87d8-c7e6cbbd9e87"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:41.630284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:41.630284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:37:41.637942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-e8dd85a2-faad-42d7-8989-63190fb0a244 req-207ca29f-b80a-4838-a0c9-674a7b49b0e0 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:41.639250 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-e8dd85a2-faad-42d7-8989-63190fb0a244 req-207ca29f-b80a-4838-a0c9-674a7b49b0e0 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:41.652385 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-e8dd85a2-faad-42d7-8989-63190fb0a244 req-207ca29f-b80a-4838-a0c9-674a7b49b0e0 service nova] Creating event network-changed:74031657-e31e-49d9-87d8-c7e6cbbd9e87 for instance 39c26b82-838e-4a45-9728-070472b9798d on hv-cinder-80447 Feb 21 02:37:41.662605 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-e8dd85a2-faad-42d7-8989-63190fb0a244 req-207ca29f-b80a-4838-a0c9-674a7b49b0e0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039251 Feb 21 02:37:41.663199 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 506/1040] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:41.903841 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4cfffa2a-93bf-4b83-9205-129940351aa4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:41.904333 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4cfffa2a-93bf-4b83-9205-129940351aa4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:41.911127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4cfffa2a-93bf-4b83-9205-129940351aa4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:41.911578 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4cfffa2a-93bf-4b83-9205-129940351aa4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:41.912390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4cfffa2a-93bf-4b83-9205-129940351aa4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:41.912823 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4cfffa2a-93bf-4b83-9205-129940351aa4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:41.937323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4cfffa2a-93bf-4b83-9205-129940351aa4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:37:42.022178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4cfffa2a-93bf-4b83-9205-129940351aa4 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 204 len: 0 microversion: 2.1 time: 0.121563 Feb 21 02:37:42.022861 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 535/1041] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:37:41 2022] DELETE /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:37:42.031484 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d0ae5c90-169d-4b99-8819-3b237151ba2b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:42.032268 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-d0ae5c90-169d-4b99-8819-3b237151ba2b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:42.039040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0ae5c90-169d-4b99-8819-3b237151ba2b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:42.039579 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0ae5c90-169d-4b99-8819-3b237151ba2b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:42.040636 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0ae5c90-169d-4b99-8819-3b237151ba2b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:42.041311 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-d0ae5c90-169d-4b99-8819-3b237151ba2b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:42.262857 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-d0ae5c90-169d-4b99-8819-3b237151ba2b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:42.270665 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d0ae5c90-169d-4b99-8819-3b237151ba2b tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1555 microversion: 2.1 time: 0.243555 Feb 21 02:37:42.271234 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 507/1042] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:42 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:42.412841 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5911e40a-34e1-4023-8fdc-2649c7a429e5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:42.413568 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5911e40a-34e1-4023-8fdc-2649c7a429e5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:42.419804 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5911e40a-34e1-4023-8fdc-2649c7a429e5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:42.420323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5911e40a-34e1-4023-8fdc-2649c7a429e5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:42.421168 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5911e40a-34e1-4023-8fdc-2649c7a429e5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:42.421611 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5911e40a-34e1-4023-8fdc-2649c7a429e5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:42.556079 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5911e40a-34e1-4023-8fdc-2649c7a429e5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:42.563425 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5911e40a-34e1-4023-8fdc-2649c7a429e5 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.154632 Feb 21 02:37:42.564502 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 536/1043] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:42 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:37:43.340842 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f07748f1-5aa0-4a7f-b9f7-2a1f7e135495 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:43.341379 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f07748f1-5aa0-4a7f-b9f7-2a1f7e135495 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:43.348077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f07748f1-5aa0-4a7f-b9f7-2a1f7e135495 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:43.348548 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f07748f1-5aa0-4a7f-b9f7-2a1f7e135495 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:43.349349 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f07748f1-5aa0-4a7f-b9f7-2a1f7e135495 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:43.349836 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f07748f1-5aa0-4a7f-b9f7-2a1f7e135495 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:43.484907 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f07748f1-5aa0-4a7f-b9f7-2a1f7e135495 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:43.492840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f07748f1-5aa0-4a7f-b9f7-2a1f7e135495 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1555 microversion: 2.1 time: 0.155778 Feb 21 02:37:43.493408 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 508/1044] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:43 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:43.580536 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-cf7d9e50-d628-4e20-97f7-0c305ae8c77e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:43.581245 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-cf7d9e50-d628-4e20-97f7-0c305ae8c77e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:43.587630 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cf7d9e50-d628-4e20-97f7-0c305ae8c77e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:43.588079 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cf7d9e50-d628-4e20-97f7-0c305ae8c77e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:43.588858 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cf7d9e50-d628-4e20-97f7-0c305ae8c77e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:43.589294 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cf7d9e50-d628-4e20-97f7-0c305ae8c77e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:43.722773 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cf7d9e50-d628-4e20-97f7-0c305ae8c77e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:43.730065 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-cf7d9e50-d628-4e20-97f7-0c305ae8c77e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.153072 Feb 21 02:37:43.730632 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 537/1045] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:43 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:44.510878 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-387a894d-acc0-47fa-8f18-e4a4f1033709 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:44.511598 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-387a894d-acc0-47fa-8f18-e4a4f1033709 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:44.518386 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-387a894d-acc0-47fa-8f18-e4a4f1033709 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:44.518823 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-387a894d-acc0-47fa-8f18-e4a4f1033709 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:44.519600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-387a894d-acc0-47fa-8f18-e4a4f1033709 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:44.520032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-387a894d-acc0-47fa-8f18-e4a4f1033709 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:44.747639 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-307d50bc-518f-495e-bea1-b4b145369632 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:44.748257 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-307d50bc-518f-495e-bea1-b4b145369632 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:44.755904 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-307d50bc-518f-495e-bea1-b4b145369632 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:44.756451 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-307d50bc-518f-495e-bea1-b4b145369632 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:44.757314 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-307d50bc-518f-495e-bea1-b4b145369632 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:44.757895 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-307d50bc-518f-495e-bea1-b4b145369632 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:44.875871 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-387a894d-acc0-47fa-8f18-e4a4f1033709 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c5ea77bceb4a15bf41fe88d0665040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f98f3ada743f7be39257e917a12c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:44.905192 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-387a894d-acc0-47fa-8f18-e4a4f1033709 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 200 len: 1555 microversion: 2.1 time: 0.398483 Feb 21 02:37:44.913488 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 509/1046] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:44 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 1555 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:44.935244 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-307d50bc-518f-495e-bea1-b4b145369632 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:44.944507 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-307d50bc-518f-495e-bea1-b4b145369632 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.201042 Feb 21 02:37:44.945342 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 538/1047] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:44 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:37:45.398024 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-3db2b4f4-b489-40a5-ab9a-787660333ee1 req-982d222b-5ffe-4b3d-af8c-0e6b92531682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba884d36-ccad-4dd6-8135-6f7bfc55077c", "name": "network-vif-deleted", "tag": "ae827098-b4d8-4d85-b652-12a13456ab7e"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:45.400133 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:45.400133 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:37:45.407308 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-3db2b4f4-b489-40a5-ab9a-787660333ee1 req-982d222b-5ffe-4b3d-af8c-0e6b92531682 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:45.408444 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-3db2b4f4-b489-40a5-ab9a-787660333ee1 req-982d222b-5ffe-4b3d-af8c-0e6b92531682 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:45.421588 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-3db2b4f4-b489-40a5-ab9a-787660333ee1 req-982d222b-5ffe-4b3d-af8c-0e6b92531682 service nova] Creating event network-vif-deleted:ae827098-b4d8-4d85-b652-12a13456ab7e for instance ba884d36-ccad-4dd6-8135-6f7bfc55077c on hv-cinder-80447 Feb 21 02:37:45.427117 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-3db2b4f4-b489-40a5-ab9a-787660333ee1 req-982d222b-5ffe-4b3d-af8c-0e6b92531682 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034157 Feb 21 02:37:45.427893 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 510/1048] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:37:45.930351 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:45.931033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] [instance: ba884d36-ccad-4dd6-8135-6f7bfc55077c] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:45.937360 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:45.937912 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:45.938837 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:45.939979 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:45.953324 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] HTTP exception thrown: Instance ba884d36-ccad-4dd6-8135-6f7bfc55077c could not be found. Feb 21 02:37:45.953941 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Returning 404 to user: Instance ba884d36-ccad-4dd6-8135-6f7bfc55077c could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:37:45.954757 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0a6a38f6-7b47-464c-b261-f414f9d9f243 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c" status: 404 len: 111 microversion: 2.1 time: 0.028403 Feb 21 02:37:45.958389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 539/1049] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:45 2022] GET /compute/v2.1/servers/ba884d36-ccad-4dd6-8135-6f7bfc55077c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:37:45.963009 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-db247462-b881-4087-843c-ec0d1d978cd8 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] Calling method '.version_select at 0x7fd85c28e9d0>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:45.964309 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-65ad1474-8694-4be3-bee6-7a43742f9efe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:45.965012 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-65ad1474-8694-4be3-bee6-7a43742f9efe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:45.972204 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-65ad1474-8694-4be3-bee6-7a43742f9efe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:45.973003 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-65ad1474-8694-4be3-bee6-7a43742f9efe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:45.973845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-65ad1474-8694-4be3-bee6-7a43742f9efe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:45.974845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-65ad1474-8694-4be3-bee6-7a43742f9efe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:45.982297 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-db247462-b881-4087-843c-ec0d1d978cd8 tempest-TestMinimumBasicScenario-230711482 tempest-TestMinimumBasicScenario-230711482-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-800918390" status: 202 len: 0 microversion: 2.1 time: 0.022652 Feb 21 02:37:45.983080 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 540/1050] 10.222.0.75 () {58 vars in 1268 bytes} [Mon Feb 21 02:37:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-800918390 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:37:46.149046 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-65ad1474-8694-4be3-bee6-7a43742f9efe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:46.157394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-65ad1474-8694-4be3-bee6-7a43742f9efe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.197441 Feb 21 02:37:46.167939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 511/1051] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:45 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:47.174983 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-90063536-fd13-40e0-8350-f1c350a96c30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:47.176153 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-90063536-fd13-40e0-8350-f1c350a96c30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:47.182222 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90063536-fd13-40e0-8350-f1c350a96c30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:47.182905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90063536-fd13-40e0-8350-f1c350a96c30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:47.183698 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90063536-fd13-40e0-8350-f1c350a96c30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:47.184129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90063536-fd13-40e0-8350-f1c350a96c30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:47.418449 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-90063536-fd13-40e0-8350-f1c350a96c30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:47.428586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-90063536-fd13-40e0-8350-f1c350a96c30 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.257848 Feb 21 02:37:47.429876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 541/1052] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:47 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:48.445593 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-28a9ee85-76c3-4659-80c7-b2867be2996f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:48.446885 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-28a9ee85-76c3-4659-80c7-b2867be2996f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:48.453196 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-28a9ee85-76c3-4659-80c7-b2867be2996f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:48.453897 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-28a9ee85-76c3-4659-80c7-b2867be2996f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:48.455603 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-28a9ee85-76c3-4659-80c7-b2867be2996f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:48.456221 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-28a9ee85-76c3-4659-80c7-b2867be2996f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:48.804234 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-28a9ee85-76c3-4659-80c7-b2867be2996f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:48.813485 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-28a9ee85-76c3-4659-80c7-b2867be2996f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.370798 Feb 21 02:37:48.819511 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 512/1053] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:48 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:49.836160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a105c41d-198a-4c6e-a37f-1475a9ef050f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:49.837960 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a105c41d-198a-4c6e-a37f-1475a9ef050f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:49.847408 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a105c41d-198a-4c6e-a37f-1475a9ef050f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:49.848389 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a105c41d-198a-4c6e-a37f-1475a9ef050f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:49.849774 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a105c41d-198a-4c6e-a37f-1475a9ef050f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:49.850299 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a105c41d-198a-4c6e-a37f-1475a9ef050f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:50.071390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-a105c41d-198a-4c6e-a37f-1475a9ef050f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:50.081242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a105c41d-198a-4c6e-a37f-1475a9ef050f tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.253903 Feb 21 02:37:50.083187 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 542/1054] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:49 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:51.097947 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-39ff6387-29b8-4daa-a505-9a600ff20bf8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:51.098947 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-39ff6387-29b8-4daa-a505-9a600ff20bf8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:51.104718 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39ff6387-29b8-4daa-a505-9a600ff20bf8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:51.105350 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39ff6387-29b8-4daa-a505-9a600ff20bf8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:51.106164 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39ff6387-29b8-4daa-a505-9a600ff20bf8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:51.107246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-39ff6387-29b8-4daa-a505-9a600ff20bf8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:51.272667 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-39ff6387-29b8-4daa-a505-9a600ff20bf8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:51.281525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-39ff6387-29b8-4daa-a505-9a600ff20bf8 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.187123 Feb 21 02:37:51.291332 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 513/1055] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:51 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:37:52.259524 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-6add7f4e-e8a7-4f35-9c79-dcc2da7f3ed4 req-7fa850b1-16ee-451f-939d-c52045eb4348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c26b82-838e-4a45-9728-070472b9798d", "name": "network-vif-plugged", "status": "completed", "tag": "74031657-e31e-49d9-87d8-c7e6cbbd9e87"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:52.261978 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:52.261978 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:37:52.269940 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-6add7f4e-e8a7-4f35-9c79-dcc2da7f3ed4 req-7fa850b1-16ee-451f-939d-c52045eb4348 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:52.270667 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-6add7f4e-e8a7-4f35-9c79-dcc2da7f3ed4 req-7fa850b1-16ee-451f-939d-c52045eb4348 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:52.282070 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-6add7f4e-e8a7-4f35-9c79-dcc2da7f3ed4 req-7fa850b1-16ee-451f-939d-c52045eb4348 service nova] Creating event network-vif-plugged:74031657-e31e-49d9-87d8-c7e6cbbd9e87 for instance 39c26b82-838e-4a45-9728-070472b9798d on hv-cinder-80447 Feb 21 02:37:52.287720 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-6add7f4e-e8a7-4f35-9c79-dcc2da7f3ed4 req-7fa850b1-16ee-451f-939d-c52045eb4348 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032209 Feb 21 02:37:52.288458 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 543/1056] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:37:52.299727 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-fdbf10d0-64f0-45ae-9b68-36c5c8e31776 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:52.301978 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-fdbf10d0-64f0-45ae-9b68-36c5c8e31776 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:52.309324 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fdbf10d0-64f0-45ae-9b68-36c5c8e31776 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:52.310138 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fdbf10d0-64f0-45ae-9b68-36c5c8e31776 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:52.311333 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fdbf10d0-64f0-45ae-9b68-36c5c8e31776 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:52.311970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-fdbf10d0-64f0-45ae-9b68-36c5c8e31776 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:52.500977 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-fdbf10d0-64f0-45ae-9b68-36c5c8e31776 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:52.510451 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-fdbf10d0-64f0-45ae-9b68-36c5c8e31776 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.215839 Feb 21 02:37:52.511020 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 514/1057] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:52 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:53.535239 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2173671e-813c-4bb2-a679-715ab1acd87e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:53.536042 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2173671e-813c-4bb2-a679-715ab1acd87e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:53.552384 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2173671e-813c-4bb2-a679-715ab1acd87e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:53.552836 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2173671e-813c-4bb2-a679-715ab1acd87e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:53.553980 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2173671e-813c-4bb2-a679-715ab1acd87e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:53.554278 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2173671e-813c-4bb2-a679-715ab1acd87e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:53.895501 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2173671e-813c-4bb2-a679-715ab1acd87e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:53.903792 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2173671e-813c-4bb2-a679-715ab1acd87e tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1264 microversion: 2.1 time: 0.378768 Feb 21 02:37:53.913531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 544/1058] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:53 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1264 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:54.920241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-0735738d-2641-4510-ae24-b7420b85be35 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:54.920845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-0735738d-2641-4510-ae24-b7420b85be35 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:54.928058 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0735738d-2641-4510-ae24-b7420b85be35 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:54.928821 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0735738d-2641-4510-ae24-b7420b85be35 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:54.929513 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0735738d-2641-4510-ae24-b7420b85be35 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:54.930000 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-0735738d-2641-4510-ae24-b7420b85be35 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:55.083799 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-0735738d-2641-4510-ae24-b7420b85be35 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:55.091923 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-0735738d-2641-4510-ae24-b7420b85be35 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1451 microversion: 2.1 time: 0.175248 Feb 21 02:37:55.092513 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 515/1059] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:54 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:55.108714 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-cfadbf17-6325-433e-9b01-b649c2333114 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:37:55.109336 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-cfadbf17-6325-433e-9b01-b649c2333114 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:37:55.116905 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cfadbf17-6325-433e-9b01-b649c2333114 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:55.117266 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cfadbf17-6325-433e-9b01-b649c2333114 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:55.118107 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cfadbf17-6325-433e-9b01-b649c2333114 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:55.118785 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cfadbf17-6325-433e-9b01-b649c2333114 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:55.358056 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cfadbf17-6325-433e-9b01-b649c2333114 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:37:55.365468 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-cfadbf17-6325-433e-9b01-b649c2333114 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1451 microversion: 2.1 time: 0.260279 Feb 21 02:37:55.366082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 545/1060] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:37:55 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1451 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:37:57.379787 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-260ff214-f518-4ac9-954e-09b789a85b1c req-8911176d-94c9-439a-961e-da4a551cdf6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c26b82-838e-4a45-9728-070472b9798d", "tag": "74031657-e31e-49d9-87d8-c7e6cbbd9e87"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:37:57.382035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:37:57.382035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:37:57.390092 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-260ff214-f518-4ac9-954e-09b789a85b1c req-8911176d-94c9-439a-961e-da4a551cdf6e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:37:57.390592 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-260ff214-f518-4ac9-954e-09b789a85b1c req-8911176d-94c9-439a-961e-da4a551cdf6e service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:37:57.402614 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-260ff214-f518-4ac9-954e-09b789a85b1c req-8911176d-94c9-439a-961e-da4a551cdf6e service nova] Creating event network-changed:74031657-e31e-49d9-87d8-c7e6cbbd9e87 for instance 39c26b82-838e-4a45-9728-070472b9798d on hv-cinder-80447 Feb 21 02:37:57.407816 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-260ff214-f518-4ac9-954e-09b789a85b1c req-8911176d-94c9-439a-961e-da4a551cdf6e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032616 Feb 21 02:37:57.411836 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 516/1061] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:38:07.479367 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1511887014", "imageRef": "3ba2653c-e292-4146-b579-48498bde0012", "flavorRef": "452"}} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:38:07.530673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.network.neutron [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] validate_networks() for None {{(pid=116711) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 02:38:07.794587 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Flavor limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 02:38:07.795009 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Image limits 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 02:38:07.795481 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Flavor pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 02:38:07.795891 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Image pref 0:0:0 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 02:38:07.796304 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.virt.hardware [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 02:38:07.805319 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:07.805809 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:07.806632 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:07.807070 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:07.823369 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Getting quotas for project 8119a8ceabe141e38b7b35d91abfc6ac. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 02:38:07.827229 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.quota [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Getting quotas for user 57614133724041a0b9e6fe287e5aa753 and project 8119a8ceabe141e38b7b35d91abfc6ac. Resources: {'ram', 'cores', 'instances'} {{(pid=116711) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 02:38:07.837858 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Going to run 1 instances... {{(pid=116711) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 02:38:07.840109 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ba2653c-e292-4146-b579-48498bde0012',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 02:38:07.886260 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a045971a-8b9d-4f3c-8876-ea48b7d461ce tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.410435 Feb 21 02:38:07.886906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 546/1062] 10.222.0.75 () {60 vars in 1146 bytes} [Mon Feb 21 02:38:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 02:38:07.897121 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-a8834241-7b12-4634-8847-517821b37827 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:07.897928 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-a8834241-7b12-4634-8847-517821b37827 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:07.952879 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-a8834241-7b12-4634-8847-517821b37827 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:07.959720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-a8834241-7b12-4634-8847-517821b37827 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1215 microversion: 2.1 time: 0.066608 Feb 21 02:38:07.960291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 517/1063] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:07 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:08.976572 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3655cc71-3a8d-47b3-81c8-66e41f76ca6a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:08.977174 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3655cc71-3a8d-47b3-81c8-66e41f76ca6a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:08.983736 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3655cc71-3a8d-47b3-81c8-66e41f76ca6a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:08.984177 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3655cc71-3a8d-47b3-81c8-66e41f76ca6a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:08.985836 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3655cc71-3a8d-47b3-81c8-66e41f76ca6a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:08.986271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3655cc71-3a8d-47b3-81c8-66e41f76ca6a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:09.044320 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3655cc71-3a8d-47b3-81c8-66e41f76ca6a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:09.052253 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3655cc71-3a8d-47b3-81c8-66e41f76ca6a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1273 microversion: 2.1 time: 0.079786 Feb 21 02:38:09.052838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 547/1064] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:08 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1273 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:10.068688 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4901f935-10f2-48b1-8d60-15eb5031778d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:10.069291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4901f935-10f2-48b1-8d60-15eb5031778d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:10.080743 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4901f935-10f2-48b1-8d60-15eb5031778d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:10.081552 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4901f935-10f2-48b1-8d60-15eb5031778d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:10.082622 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4901f935-10f2-48b1-8d60-15eb5031778d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:10.083053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4901f935-10f2-48b1-8d60-15eb5031778d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:10.315406 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4901f935-10f2-48b1-8d60-15eb5031778d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:10.341747 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4901f935-10f2-48b1-8d60-15eb5031778d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1315 microversion: 2.1 time: 0.275875 Feb 21 02:38:10.342514 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 518/1065] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:10 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:10.447252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-6dbe9694-f55e-4ebe-b551-98763a32728f req-fc0ddf45-b365-406c-9c4a-6dade97dd1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3657cf4c-0a26-465e-8dea-3adbf9916202", "tag": "23ac470f-e8f2-45ed-b489-5fda44351723"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:38:10.449390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:38:10.449390 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:38:10.460890 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-6dbe9694-f55e-4ebe-b551-98763a32728f req-fc0ddf45-b365-406c-9c4a-6dade97dd1d1 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:10.461253 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-6dbe9694-f55e-4ebe-b551-98763a32728f req-fc0ddf45-b365-406c-9c4a-6dade97dd1d1 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:10.472385 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-6dbe9694-f55e-4ebe-b551-98763a32728f req-fc0ddf45-b365-406c-9c4a-6dade97dd1d1 service nova] Creating event network-changed:23ac470f-e8f2-45ed-b489-5fda44351723 for instance 3657cf4c-0a26-465e-8dea-3adbf9916202 on hv-cinder-80447 Feb 21 02:38:10.477251 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-6dbe9694-f55e-4ebe-b551-98763a32728f req-fc0ddf45-b365-406c-9c4a-6dade97dd1d1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179660 Feb 21 02:38:10.477912 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 548/1066] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:38:11.358713 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-4f07f6b6-bbb8-4af3-b800-246df88d180b tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:11.359254 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-4f07f6b6-bbb8-4af3-b800-246df88d180b tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:11.366294 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4f07f6b6-bbb8-4af3-b800-246df88d180b tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:11.366739 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4f07f6b6-bbb8-4af3-b800-246df88d180b tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:11.367511 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4f07f6b6-bbb8-4af3-b800-246df88d180b tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:11.367940 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-4f07f6b6-bbb8-4af3-b800-246df88d180b tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:11.502065 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-4f07f6b6-bbb8-4af3-b800-246df88d180b tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:11.509662 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-4f07f6b6-bbb8-4af3-b800-246df88d180b tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1315 microversion: 2.1 time: 0.154626 Feb 21 02:38:11.510237 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 519/1067] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:11 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:12.526714 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-34528256-5ffb-405e-98f4-5bb4f78a70db tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:12.527430 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-34528256-5ffb-405e-98f4-5bb4f78a70db tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:12.533526 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-34528256-5ffb-405e-98f4-5bb4f78a70db tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:12.533998 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-34528256-5ffb-405e-98f4-5bb4f78a70db tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:12.534770 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-34528256-5ffb-405e-98f4-5bb4f78a70db tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:12.535198 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-34528256-5ffb-405e-98f4-5bb4f78a70db tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:12.670969 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-34528256-5ffb-405e-98f4-5bb4f78a70db tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:12.678840 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-34528256-5ffb-405e-98f4-5bb4f78a70db tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1315 microversion: 2.1 time: 0.156560 Feb 21 02:38:12.679400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 549/1068] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:12 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:13.695956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-619c1c4a-eaa5-453b-9019-96c0388510c2 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:13.696567 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-619c1c4a-eaa5-453b-9019-96c0388510c2 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:13.702872 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-619c1c4a-eaa5-453b-9019-96c0388510c2 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:13.703323 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-619c1c4a-eaa5-453b-9019-96c0388510c2 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:13.704099 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-619c1c4a-eaa5-453b-9019-96c0388510c2 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:13.704605 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-619c1c4a-eaa5-453b-9019-96c0388510c2 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:13.834268 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-619c1c4a-eaa5-453b-9019-96c0388510c2 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:13.841477 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-619c1c4a-eaa5-453b-9019-96c0388510c2 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1315 microversion: 2.1 time: 0.149146 Feb 21 02:38:13.842109 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 520/1069] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:13 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:14.858383 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c31ad1f7-9164-48f4-a7a4-18ea9492b4ed tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:14.858987 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c31ad1f7-9164-48f4-a7a4-18ea9492b4ed tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:14.866086 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c31ad1f7-9164-48f4-a7a4-18ea9492b4ed tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:14.866540 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c31ad1f7-9164-48f4-a7a4-18ea9492b4ed tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:14.867325 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c31ad1f7-9164-48f4-a7a4-18ea9492b4ed tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:14.867758 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c31ad1f7-9164-48f4-a7a4-18ea9492b4ed tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:15.002006 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c31ad1f7-9164-48f4-a7a4-18ea9492b4ed tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:15.009372 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c31ad1f7-9164-48f4-a7a4-18ea9492b4ed tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1315 microversion: 2.1 time: 0.154624 Feb 21 02:38:15.009967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 550/1070] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:14 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:16.025313 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-18d8c325-def1-4fff-85ab-75072399f9d3 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:16.025956 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-18d8c325-def1-4fff-85ab-75072399f9d3 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:16.032220 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-18d8c325-def1-4fff-85ab-75072399f9d3 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:16.032664 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-18d8c325-def1-4fff-85ab-75072399f9d3 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:16.033438 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-18d8c325-def1-4fff-85ab-75072399f9d3 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:16.033959 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-18d8c325-def1-4fff-85ab-75072399f9d3 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:16.164298 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-18d8c325-def1-4fff-85ab-75072399f9d3 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:16.171533 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-18d8c325-def1-4fff-85ab-75072399f9d3 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1315 microversion: 2.1 time: 0.149884 Feb 21 02:38:16.172098 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 521/1071] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:16 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:16.386309 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-3ea71d78-d6af-4565-a38f-19848d9adf71 req-e4a32068-9eea-4880-9fa1-adcab05d963c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3657cf4c-0a26-465e-8dea-3adbf9916202", "name": "network-vif-plugged", "status": "completed", "tag": "23ac470f-e8f2-45ed-b489-5fda44351723"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:38:16.387834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:38:16.387834 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:38:16.396360 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-3ea71d78-d6af-4565-a38f-19848d9adf71 req-e4a32068-9eea-4880-9fa1-adcab05d963c service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:16.396815 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-3ea71d78-d6af-4565-a38f-19848d9adf71 req-e4a32068-9eea-4880-9fa1-adcab05d963c service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:16.408961 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-3ea71d78-d6af-4565-a38f-19848d9adf71 req-e4a32068-9eea-4880-9fa1-adcab05d963c service nova] Creating event network-vif-plugged:23ac470f-e8f2-45ed-b489-5fda44351723 for instance 3657cf4c-0a26-465e-8dea-3adbf9916202 on hv-cinder-80447 Feb 21 02:38:16.414488 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-3ea71d78-d6af-4565-a38f-19848d9adf71 req-e4a32068-9eea-4880-9fa1-adcab05d963c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031773 Feb 21 02:38:16.415092 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 551/1072] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:38:17.188536 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ff74f0e8-4280-4f0d-9586-a48b9db3fbae tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:17.189134 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ff74f0e8-4280-4f0d-9586-a48b9db3fbae tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:17.195457 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ff74f0e8-4280-4f0d-9586-a48b9db3fbae tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:17.195900 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ff74f0e8-4280-4f0d-9586-a48b9db3fbae tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:17.196758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ff74f0e8-4280-4f0d-9586-a48b9db3fbae tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:17.197186 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ff74f0e8-4280-4f0d-9586-a48b9db3fbae tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:17.351789 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ff74f0e8-4280-4f0d-9586-a48b9db3fbae tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:17.358921 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ff74f0e8-4280-4f0d-9586-a48b9db3fbae tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1315 microversion: 2.1 time: 0.174270 Feb 21 02:38:17.359746 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 522/1073] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:17 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:18.377475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-45454f68-ce0d-4573-890a-ddbd363718a4 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:18.379016 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-45454f68-ce0d-4573-890a-ddbd363718a4 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:18.386301 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-45454f68-ce0d-4573-890a-ddbd363718a4 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:18.387033 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-45454f68-ce0d-4573-890a-ddbd363718a4 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:18.387819 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-45454f68-ce0d-4573-890a-ddbd363718a4 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:18.388249 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-45454f68-ce0d-4573-890a-ddbd363718a4 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:18.526097 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-45454f68-ce0d-4573-890a-ddbd363718a4 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:18.533160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-45454f68-ce0d-4573-890a-ddbd363718a4 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1465 microversion: 2.1 time: 0.160335 Feb 21 02:38:18.533740 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 552/1074] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:18 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1465 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:18.569477 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e51c8960-984e-43da-aa22-3f7fd7ad0a0a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:18.570057 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e51c8960-984e-43da-aa22-3f7fd7ad0a0a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:18.575918 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e51c8960-984e-43da-aa22-3f7fd7ad0a0a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:18.576367 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e51c8960-984e-43da-aa22-3f7fd7ad0a0a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:18.577139 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e51c8960-984e-43da-aa22-3f7fd7ad0a0a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:18.577578 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e51c8960-984e-43da-aa22-3f7fd7ad0a0a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:18.601438 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e51c8960-984e-43da-aa22-3f7fd7ad0a0a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:38:18.676603 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e51c8960-984e-43da-aa22-3f7fd7ad0a0a tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "DELETE /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 204 len: 0 microversion: 2.1 time: 0.109796 Feb 21 02:38:18.677467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 523/1075] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:38:18 2022] DELETE /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:38:18.685496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e0e569b4-d784-4e9a-b33c-12f192c3187d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:18.686163 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e0e569b4-d784-4e9a-b33c-12f192c3187d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:18.692223 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e0e569b4-d784-4e9a-b33c-12f192c3187d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:18.692666 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e0e569b4-d784-4e9a-b33c-12f192c3187d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:18.693435 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e0e569b4-d784-4e9a-b33c-12f192c3187d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:18.693918 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e0e569b4-d784-4e9a-b33c-12f192c3187d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:18.821919 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e0e569b4-d784-4e9a-b33c-12f192c3187d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:18.829134 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e0e569b4-d784-4e9a-b33c-12f192c3187d tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1471 microversion: 2.1 time: 0.147311 Feb 21 02:38:18.829709 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 553/1076] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:18 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:19.846791 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-55762eaf-e730-4290-9db5-1a9e377f91fd tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:19.847479 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-55762eaf-e730-4290-9db5-1a9e377f91fd tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:19.854169 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55762eaf-e730-4290-9db5-1a9e377f91fd tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:19.854611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55762eaf-e730-4290-9db5-1a9e377f91fd tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:19.855395 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55762eaf-e730-4290-9db5-1a9e377f91fd tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:19.855804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-55762eaf-e730-4290-9db5-1a9e377f91fd tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:19.992848 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-55762eaf-e730-4290-9db5-1a9e377f91fd tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:19.999987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-55762eaf-e730-4290-9db5-1a9e377f91fd tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1471 microversion: 2.1 time: 0.157372 Feb 21 02:38:20.000551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 524/1077] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:19 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:20.834838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-8ea1f168-5d1e-4fd8-97a2-c56806ad8b4a req-3b1aa31e-0492-4df4-8839-c9cc4817c407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3657cf4c-0a26-465e-8dea-3adbf9916202", "name": "network-vif-deleted", "tag": "23ac470f-e8f2-45ed-b489-5fda44351723"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:38:20.836464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:38:20.836464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:38:20.844552 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-8ea1f168-5d1e-4fd8-97a2-c56806ad8b4a req-3b1aa31e-0492-4df4-8839-c9cc4817c407 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:20.844994 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-8ea1f168-5d1e-4fd8-97a2-c56806ad8b4a req-3b1aa31e-0492-4df4-8839-c9cc4817c407 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:20.858065 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-8ea1f168-5d1e-4fd8-97a2-c56806ad8b4a req-3b1aa31e-0492-4df4-8839-c9cc4817c407 service nova] Creating event network-vif-deleted:23ac470f-e8f2-45ed-b489-5fda44351723 for instance 3657cf4c-0a26-465e-8dea-3adbf9916202 on hv-cinder-80447 Feb 21 02:38:20.863558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-8ea1f168-5d1e-4fd8-97a2-c56806ad8b4a req-3b1aa31e-0492-4df4-8839-c9cc4817c407 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032875 Feb 21 02:38:20.866307 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 554/1078] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:38:21.017467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:21.018095 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:21.024828 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:21.025267 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:21.026060 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:21.026491 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:21.055425 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:21.055800 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:21.056237 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lazy-loading 'fault' on Instance uuid 3657cf4c-0a26-465e-8dea-3adbf9916202 {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:38:21.098104 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57614133724041a0b9e6fe287e5aa753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a8ceabe141e38b7b35d91abfc6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:38:21.105253 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-440814cd-ecb6-4ca9-ba5e-37b421fa9ed9 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 200 len: 1305 microversion: 2.1 time: 0.091432 Feb 21 02:38:21.105840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 525/1079] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:21 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:38:22.123690 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:38:22.124381 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] [instance: 3657cf4c-0a26-465e-8dea-3adbf9916202] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:38:22.130439 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:22.130889 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:22.131647 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:38:22.132082 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:38:22.145236 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] HTTP exception thrown: Instance 3657cf4c-0a26-465e-8dea-3adbf9916202 could not be found. Feb 21 02:38:22.145833 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] Returning 404 to user: Instance 3657cf4c-0a26-465e-8dea-3adbf9916202 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:38:22.146630 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-04031ae8-89d1-4233-97ae-981121715e58 tempest-VolumesNegativeTest-1569935642 tempest-VolumesNegativeTest-1569935642-project] 10.222.0.75 "GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202" status: 404 len: 111 microversion: 2.1 time: 0.027408 Feb 21 02:38:22.147144 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 555/1080] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:38:22 2022] GET /compute/v2.1/servers/3657cf4c-0a26-465e-8dea-3adbf9916202 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:39:04.842086 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-31867150-6d1f-4616-844a-4d2dc152f0d2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:39:04.842690 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-31867150-6d1f-4616-844a-4d2dc152f0d2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:04.848792 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-31867150-6d1f-4616-844a-4d2dc152f0d2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:04.849288 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-31867150-6d1f-4616-844a-4d2dc152f0d2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:04.850720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-31867150-6d1f-4616-844a-4d2dc152f0d2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:04.851163 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-31867150-6d1f-4616-844a-4d2dc152f0d2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:04.874839 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.objects.instance [None req-31867150-6d1f-4616-844a-4d2dc152f0d2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lazy-loading 'flavor' on Instance uuid c0405d8a-efb9-44d0-a689-bf32224aefbc {{(pid=116710) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:39:05.133589 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-31867150-6d1f-4616-844a-4d2dc152f0d2 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/action" status: 202 len: 0 microversion: 2.20 time: 0.295065 Feb 21 02:39:05.134417 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 526/1081] 10.222.0.75 () {62 vars in 1318 bytes} [Mon Feb 21 02:39:04 2022] POST /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 21 02:39:05.142145 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:05.142753 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:05.149279 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:05.149751 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:05.150568 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:05.150980 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:05.282762 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:05.291125 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:05.292600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:05.293773 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-90581999-c1a6-4ce5-a314-827e985875c4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.155334 Feb 21 02:39:05.294329 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 556/1082] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:05 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:06.313209 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:06.313930 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:06.320692 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:06.321129 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:06.321937 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:06.322369 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:06.462077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:06.469679 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:06.471148 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:06.472296 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-abe6ce6f-3c28-40b8-846e-d3b5982248dc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.163703 Feb 21 02:39:06.472846 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 527/1083] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:06 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:07.492038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:07.492558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:07.498956 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:07.499406 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:07.500176 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:07.500609 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:07.633853 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:07.641825 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:07.643369 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:07.644517 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-50f275d8-b924-4275-9933-67a6fc8c0dc7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.156390 Feb 21 02:39:07.645075 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 557/1084] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:07 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:08.663834 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:08.664445 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:08.670729 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:08.671172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:08.671942 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:08.672408 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:08.802286 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:08.811546 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:08.813023 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:08.814203 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-84fd18c6-7239-4569-8b03-2f188ede68af tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.155019 Feb 21 02:39:08.814757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 528/1085] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:08 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:09.831788 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:09.832368 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:09.838694 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:09.839242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:09.840165 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:09.840634 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:09.978954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:09.986952 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:09.988426 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:09.989561 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-72c07472-6e5e-4e3a-b856-b56d29f921c3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.161489 Feb 21 02:39:09.990158 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 558/1086] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:09 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:11.008085 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:11.008621 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:11.014824 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:11.015267 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:11.016030 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:11.016459 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:11.400957 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:11.408541 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:11.410076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:11.411221 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-095f9c41-50f2-4dd9-9005-fde484d8b4ba tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.407458 Feb 21 02:39:11.411771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 529/1087] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:11 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:39:12.430242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:12.430841 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:12.437079 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:12.437550 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:12.438351 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:12.438784 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:12.569686 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:12.577240 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:12.578744 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:12.579883 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-baecc1e5-351a-451f-b42f-a2a8dc92439d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.153499 Feb 21 02:39:12.580436 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 559/1088] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:12 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:13.598583 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:13.599101 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:13.605917 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:13.606364 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:13.607129 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:13.607559 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:13.737803 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:13.745534 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:13.747035 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:13.748181 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-41685051-fb19-4be6-9192-9ef9c7f17337 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.153416 Feb 21 02:39:13.748741 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 530/1089] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:13 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:39:14.766138 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:14.766733 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:14.772967 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:14.773411 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:14.774211 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:14.774641 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:14.907822 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:14.915940 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:14.917405 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:14.918582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-31d0a92f-c004-4168-8c63-aaa6a0a429b1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.156151 Feb 21 02:39:14.919152 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 560/1090] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:14 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:15.937313 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:15.938010 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:15.944614 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:15.945063 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:15.945881 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:15.946320 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:16.078578 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:16.086607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:16.088091 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:16.089238 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-df5943d8-999d-4858-a9c2-1e0d6a3ddf05 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.155667 Feb 21 02:39:16.089814 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 531/1091] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:15 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:17.108477 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:17.109072 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:17.116252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:17.116778 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:17.117558 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:17.118087 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:17.262586 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:17.271074 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:17.272607 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:17.273815 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4eff12de-0b98-4963-b40b-fd04997a8e6a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1747 microversion: 2.20 time: 0.169277 Feb 21 02:39:17.274379 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 561/1092] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:17 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1747 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:18.292972 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:18.293621 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:18.299892 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:18.300339 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:18.301106 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:18.301541 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:18.432104 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:18.439913 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:18.441384 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:18.442935 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e01d3965-23bb-4d92-a4c9-5c017ba115bd tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1747 microversion: 2.20 time: 0.153625 Feb 21 02:39:18.444344 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 532/1093] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:18 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:39:19.461978 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:19.462523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:19.468703 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:19.469142 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:19.469937 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:19.470369 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:19.600242 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:19.607908 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:19.609371 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:19.610801 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-30318990-4446-4fd2-9ed7-01302ef15e9f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1747 microversion: 2.20 time: 0.152909 Feb 21 02:39:19.611354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 562/1094] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:19 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:20.628368 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:20.628981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:20.635304 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:20.635754 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:20.636528 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:20.636960 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:20.750221 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-a93ffaee-c4d0-49cd-8bf4-eebee0a15594 req-966e35d1-9c50-4802-99d4-d7294091657b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0405d8a-efb9-44d0-a689-bf32224aefbc", "name": "network-vif-plugged", "status": "completed", "tag": "49c16a7e-5b17-4b9c-8fa6-77d95496d4b8"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:39:20.751793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:39:20.751793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:39:20.759776 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-a93ffaee-c4d0-49cd-8bf4-eebee0a15594 req-966e35d1-9c50-4802-99d4-d7294091657b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:20.760209 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-a93ffaee-c4d0-49cd-8bf4-eebee0a15594 req-966e35d1-9c50-4802-99d4-d7294091657b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:20.771059 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-a93ffaee-c4d0-49cd-8bf4-eebee0a15594 req-966e35d1-9c50-4802-99d4-d7294091657b service nova] Creating event network-vif-plugged:49c16a7e-5b17-4b9c-8fa6-77d95496d4b8 for instance c0405d8a-efb9-44d0-a689-bf32224aefbc on hv-cinder-80447 Feb 21 02:39:20.776410 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:20.781624 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-a93ffaee-c4d0-49cd-8bf4-eebee0a15594 req-966e35d1-9c50-4802-99d4-d7294091657b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035690 Feb 21 02:39:20.782582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 563/1095] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:39:20.786025 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:20.788393 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:20.789713 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-271b4232-9776-46aa-8326-db2ab2ac584e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1747 microversion: 2.20 time: 0.165132 Feb 21 02:39:20.790417 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 533/1096] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:20 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:21.809307 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:21.810030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:21.816038 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:21.816492 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:21.817268 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:21.817739 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:21.951117 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:21.958684 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:21.961076 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:21.962275 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-724ad1c4-d4df-41a4-9950-1b1c369c9f6d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1747 microversion: 2.20 time: 0.157510 Feb 21 02:39:21.962825 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 564/1097] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:21 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:22.979372 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:22.979976 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:22.986811 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:22.987256 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:22.988053 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:22.988483 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:23.127981 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:23.137132 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:23.138706 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:23.139987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-74d619b9-13bd-407e-8e63-1f44b756139d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.164322 Feb 21 02:39:23.140550 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 534/1098] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:22 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:39:24.158673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:24.159251 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:24.166713 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:24.167545 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:24.168649 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:24.169202 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:24.313591 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:24.323338 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:24.324868 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:24.326059 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-c801ee03-4dd1-4fc0-9c89-11f2771face7 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.171389 Feb 21 02:39:24.337996 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 565/1099] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:24 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:39:25.345403 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:25.346044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:25.352614 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:25.353067 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:25.353877 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:25.354314 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:25.494493 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:25.502243 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:25.503719 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:25.504882 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-bf5274cc-ae4e-4b68-94cd-655e52beda0d tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.163235 Feb 21 02:39:25.505431 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 535/1100] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:25 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:26.524781 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:26.526052 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:26.532476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:26.532937 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:26.533741 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:26.534185 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:26.697499 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:26.706332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:26.707822 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:26.709765 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e97a58a9-e925-486b-bc87-6162e7130766 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.188901 Feb 21 02:39:26.710346 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 566/1101] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:26 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:27.728322 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:27.729563 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:27.737934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:27.738404 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:27.739188 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:27.739620 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:27.889452 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:27.898567 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:27.901003 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:27.902448 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-5ab0c33a-1db0-450e-bade-43964a714450 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.178368 Feb 21 02:39:27.903535 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 536/1102] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:27 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:28.921236 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:28.921991 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:28.928836 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:28.929371 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:28.930442 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:28.930955 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:29.077944 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:29.088200 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:29.090007 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:29.091442 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-2b79e383-ec84-4e33-be82-c1f0ee4ad9d6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.173930 Feb 21 02:39:29.102582 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 567/1103] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:28 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:30.111611 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:30.112315 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:30.119027 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:30.119476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:30.120254 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:30.120684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:30.286070 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:30.295465 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:30.296945 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:30.299158 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-ec9f3672-d0a6-4ab1-b940-f493bc5d7f27 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.192359 Feb 21 02:39:30.300538 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 537/1104] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:30 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:31.319886 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:31.320486 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:31.334978 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:31.335431 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:31.336220 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:31.336659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:31.509332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:31.518210 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:31.519695 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:31.520847 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-cd0eb69d-d87f-44ae-b761-9ed414a813d3 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.205341 Feb 21 02:39:31.525727 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 568/1105] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:31 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:32.540023 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:32.541056 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:32.549991 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:32.550771 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:32.551511 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:32.551951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:32.718253 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:32.726933 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:32.728502 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:32.729815 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7cb84461-7a2b-4a19-9c1d-f58fffdf7440 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.194280 Feb 21 02:39:32.730637 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 538/1106] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:32 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:33.747703 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:33.748223 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:33.754469 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:33.754920 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:33.756212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:33.756713 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:33.888241 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:33.895784 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:33.897976 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:33.899151 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-f6011046-ea92-4d99-a734-d282ec5fa7ed tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1742 microversion: 2.20 time: 0.155249 Feb 21 02:39:33.899729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 569/1107] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:33 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:34.917748 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:34.918353 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:34.924512 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:34.924951 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:34.925744 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:34.926175 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:35.060837 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:35.069072 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:35.070586 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:35.071715 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e434ac44-5719-41ea-b509-2ca9276831d4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1724 microversion: 2.20 time: 0.157728 Feb 21 02:39:35.072260 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 539/1108] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:34 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:36.090618 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:36.091270 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:36.097487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:36.097994 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:36.098763 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:36.099192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:36.229263 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:36.237083 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:36.238581 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:36.239720 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-09713163-7044-422b-95c6-efbeeeafbfde tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1724 microversion: 2.20 time: 0.152781 Feb 21 02:39:36.240277 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 570/1109] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:36 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:36.771602 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-063c79ba-9561-4750-af15-3e8f4abb0105 req-49c5957c-9adb-4ce6-ab08-9d13c04bf783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0405d8a-efb9-44d0-a689-bf32224aefbc", "name": "network-vif-unplugged", "status": "completed", "tag": "49c16a7e-5b17-4b9c-8fa6-77d95496d4b8"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:39:36.773728 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:39:36.773728 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:39:36.782268 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-063c79ba-9561-4750-af15-3e8f4abb0105 req-49c5957c-9adb-4ce6-ab08-9d13c04bf783 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:36.783230 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-063c79ba-9561-4750-af15-3e8f4abb0105 req-49c5957c-9adb-4ce6-ab08-9d13c04bf783 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:36.797817 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-063c79ba-9561-4750-af15-3e8f4abb0105 req-49c5957c-9adb-4ce6-ab08-9d13c04bf783 service nova] Creating event network-vif-unplugged:49c16a7e-5b17-4b9c-8fa6-77d95496d4b8 for instance c0405d8a-efb9-44d0-a689-bf32224aefbc on hv-cinder-80447 Feb 21 02:39:36.802876 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-063c79ba-9561-4750-af15-3e8f4abb0105 req-49c5957c-9adb-4ce6-ab08-9d13c04bf783 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034879 Feb 21 02:39:36.804307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 540/1110] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:39:37.258627 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:37.259225 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:37.265388 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:37.265876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:37.266641 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:37.267071 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:37.403178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:37.410970 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:37.412446 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:37.413623 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ddeaea30-3bb3-4f02-96de-3ee0d27849b4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1667 microversion: 2.20 time: 0.159153 Feb 21 02:39:37.414383 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 571/1111] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:37 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:37.431764 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1f11b8e0-65d7-4c41-8878-38b2fb9ccc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0d8a2eb-055b-400c-8806-b33c0ef5d720"}} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:39:37.432828 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1f11b8e0-65d7-4c41-8878-38b2fb9ccc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:37.439101 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f11b8e0-65d7-4c41-8878-38b2fb9ccc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:37.439555 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f11b8e0-65d7-4c41-8878-38b2fb9ccc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:37.440370 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f11b8e0-65d7-4c41-8878-38b2fb9ccc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:37.440808 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1f11b8e0-65d7-4c41-8878-38b2fb9ccc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:37.703997 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1f11b8e0-65d7-4c41-8878-38b2fb9ccc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.276589 Feb 21 02:39:37.704595 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 541/1112] 10.222.0.75 () {62 vars in 1363 bytes} [Mon Feb 21 02:39:37 2022] POST /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/os-volume_attachments => generated 188 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 02:39:37.813013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-424ef156-e95f-4bb5-8dd4-36df1ca06e66 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:37.813511 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-424ef156-e95f-4bb5-8dd4-36df1ca06e66 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:37.819287 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-424ef156-e95f-4bb5-8dd4-36df1ca06e66 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:37.819741 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-424ef156-e95f-4bb5-8dd4-36df1ca06e66 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:37.820551 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-424ef156-e95f-4bb5-8dd4-36df1ca06e66 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:37.821523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-424ef156-e95f-4bb5-8dd4-36df1ca06e66 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:38.031233 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-424ef156-e95f-4bb5-8dd4-36df1ca06e66 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/os-volume_attachments/c0d8a2eb-055b-400c-8806-b33c0ef5d720" status: 202 len: 0 microversion: 2.20 time: 0.221866 Feb 21 02:39:38.031842 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 572/1113] 10.222.0.75 () {60 vars in 1456 bytes} [Mon Feb 21 02:39:37 2022] DELETE /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/os-volume_attachments/c0d8a2eb-055b-400c-8806-b33c0ef5d720 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:39:38.085172 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-374cecbf-aabc-43d4-9f3c-db1faf975de8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:39:38.085762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-374cecbf-aabc-43d4-9f3c-db1faf975de8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:38.092821 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-374cecbf-aabc-43d4-9f3c-db1faf975de8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:38.093265 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-374cecbf-aabc-43d4-9f3c-db1faf975de8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:38.094077 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-374cecbf-aabc-43d4-9f3c-db1faf975de8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:38.094514 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-374cecbf-aabc-43d4-9f3c-db1faf975de8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:38.225002 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-374cecbf-aabc-43d4-9f3c-db1faf975de8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "POST /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/action" status: 202 len: 0 microversion: 2.20 time: 0.143396 Feb 21 02:39:38.225758 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 542/1114] 10.222.0.75 () {62 vars in 1318 bytes} [Mon Feb 21 02:39:38 2022] POST /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:39:38.233276 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:38.233908 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:38.239838 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:38.240292 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:38.241101 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:38.241542 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:38.381584 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:38.390493 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:38.391980 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:38.393149 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-fb475af7-f1f2-4b8c-8769-004e9cf8a6cf tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1675 microversion: 2.20 time: 0.163520 Feb 21 02:39:38.393962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 573/1115] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:38 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:39.411846 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:39.412451 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:39.419040 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:39.419508 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:39.420291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:39.420699 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:39.608845 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:39.617029 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:39.619447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:39.620460 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-eb9d08c0-6c4b-41f0-8b46-e944049bf9a8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.212783 Feb 21 02:39:39.621015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 543/1116] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:39 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:40.639511 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:40.640115 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:40.646456 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:40.647198 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:40.648264 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:40.649523 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:40.803161 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:40.812013 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:40.813866 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:40.815252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6f07d119-048c-44b3-93f3-d6cb5ed807fe tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.179453 Feb 21 02:39:40.816034 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 574/1117] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:40 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:41.834049 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:41.834783 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:41.841870 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:41.842385 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:41.843235 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:41.843731 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:41.988829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:41.998158 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:41.999643 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:42.000840 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-7dbedead-537c-4957-9603-41bf9a03c51e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.170576 Feb 21 02:39:42.001594 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 544/1118] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:41 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:43.020844 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:43.021472 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:43.033587 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:43.034080 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:43.034884 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:43.035331 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:43.179911 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:43.187766 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:43.189235 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:43.190395 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-12cc60f0-a9a8-4430-87b6-14bf00fde74c tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.173204 Feb 21 02:39:43.190943 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 575/1119] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:43 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:44.208060 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:44.208672 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:44.214938 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:44.215388 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:44.216168 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:44.216607 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:44.358009 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:44.366223 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:44.368263 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:44.369374 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-abfa2775-16cc-425a-8868-8299a4b27171 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.165020 Feb 21 02:39:44.369959 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 545/1120] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:44 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:45.388192 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:45.388793 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:45.395323 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:45.395760 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:45.396527 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:45.396954 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:45.535202 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:45.543293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:45.544727 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:45.545898 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5bd0e7d8-3e85-4a87-9a0a-c0166ff4f4e4 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.161460 Feb 21 02:39:45.546464 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 576/1121] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:45 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:46.564187 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:46.564766 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:46.571157 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:46.571647 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:46.572502 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:46.572929 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:46.715295 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:46.723100 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:46.724568 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:46.725731 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-17c04e1f-94f8-4ee7-8e99-cf440f136d82 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.165221 Feb 21 02:39:46.726284 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 546/1122] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:46 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:47.749956 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:47.750981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:47.761274 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:47.762595 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:47.764496 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:47.765574 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:47.912473 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:47.920928 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:47.922441 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:47.923581 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-53e9956a-03ea-47c9-bdc0-0ccd1b4a1fbc tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.181104 Feb 21 02:39:47.924135 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 577/1123] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:47 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:48.942349 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:48.942947 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:48.949503 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:48.949974 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:48.950744 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:48.951170 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:49.089191 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:49.098684 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:49.100214 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:49.101390 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-aca0d758-154e-414a-8946-d1599135547f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.162791 Feb 21 02:39:49.101982 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 547/1124] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:48 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:50.121364 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:50.122058 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:50.128705 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:50.129252 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:50.130163 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:50.130677 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:50.267126 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:50.276797 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:50.278533 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:50.279778 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-af7afbe9-3489-473d-a321-a7c78cae45d8 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.162875 Feb 21 02:39:50.280554 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 578/1125] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:50 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:39:51.297720 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:51.298289 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:51.304194 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:51.304647 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:51.305422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:51.305934 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:51.439349 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:51.447524 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:51.448987 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:51.450152 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-52b9140a-d788-49d2-813f-9059d4da124a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.156249 Feb 21 02:39:51.450697 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 548/1126] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:51 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:52.467803 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:52.468404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:52.474673 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:52.475124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:52.475889 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:52.476404 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:52.610417 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:52.618427 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:52.619845 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:52.620980 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-3f7162f7-05f9-4868-b83b-efcac91c8827 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.156857 Feb 21 02:39:52.621528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 579/1127] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:52 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:53.639600 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:53.640211 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:53.646409 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:53.646849 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:53.647616 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:53.648044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:53.778837 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:53.786476 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:53.787970 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:53.789120 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-6810f490-0f12-411b-b539-439000fbdad6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.153219 Feb 21 02:39:53.789696 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 549/1128] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:53 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:39:54.807148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:54.807728 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:54.813981 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:54.814420 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:54.815180 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:54.815610 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:54.949152 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:54.956763 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:54.958267 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:54.959399 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-8c35248e-8588-4b4a-bb9f-d9549e53ec96 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.156024 Feb 21 02:39:54.959957 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 580/1129] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:54 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:55.977214 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:55.977865 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:55.984068 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:55.984515 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:55.985301 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:55.985772 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:56.187532 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:56.195490 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:56.197848 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:56.199014 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2d3e4541-de5f-45e5-a487-14169ca93fbb tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.225553 Feb 21 02:39:56.209586 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 550/1130] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:55 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:57.216548 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:57.217148 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:57.223328 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:57.223772 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:57.224536 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:57.224968 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:57.357012 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:57.364891 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:57.366418 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:57.367568 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-6d7e1ae4-3bc1-44d7-9cb9-86e66da1a917 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.154716 Feb 21 02:39:57.368631 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 581/1131] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:57 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:58.386447 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:58.387076 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:58.393276 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:58.393757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:58.394525 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:58.394954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:58.529886 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:58.537532 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:58.539114 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:58.540465 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-43f90c5f-7cfb-48e2-a44c-1edd1b1a75be tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.158154 Feb 21 02:39:58.541021 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 551/1132] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:58 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:39:59.558589 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:39:59.559124 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:39:59.565284 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:59.565754 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:59.566520 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:39:59.566952 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:39:59.697129 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:59.704949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:59.706470 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:39:59.707617 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-e287b198-5931-46bf-8089-1a9c1b172a53 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.153455 Feb 21 02:39:59.708179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 582/1133] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:39:59 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:40:00.726032 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:00.726642 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:00.732887 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:00.733339 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:00.734153 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:00.734592 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:00.867418 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:00.875628 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:00.877112 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:00.878393 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-57daac67-446e-48be-9556-34ed368f554f tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.156143 Feb 21 02:40:00.878944 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 552/1134] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:40:00 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:40:00.970194 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [req-bf01dc42-8407-4446-b380-9ccc0e398a63 req-0b67eea4-4c18-40f5-8fe1-815ecaedfc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0405d8a-efb9-44d0-a689-bf32224aefbc", "name": "network-vif-plugged", "status": "completed", "tag": "49c16a7e-5b17-4b9c-8fa6-77d95496d4b8"}]} {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:40:00.971808 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:40:00.971808 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: warnings.warn(msg) Feb 21 02:40:00.979810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-bf01dc42-8407-4446-b380-9ccc0e398a63 req-0b67eea4-4c18-40f5-8fe1-815ecaedfc1b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:00.979810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [req-bf01dc42-8407-4446-b380-9ccc0e398a63 req-0b67eea4-4c18-40f5-8fe1-815ecaedfc1b service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:00.990639 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.compute.server_external_events [req-bf01dc42-8407-4446-b380-9ccc0e398a63 req-0b67eea4-4c18-40f5-8fe1-815ecaedfc1b service nova] Creating event network-vif-plugged:49c16a7e-5b17-4b9c-8fa6-77d95496d4b8 for instance c0405d8a-efb9-44d0-a689-bf32224aefbc on hv-cinder-80447 Feb 21 02:40:00.996450 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [req-bf01dc42-8407-4446-b380-9ccc0e398a63 req-0b67eea4-4c18-40f5-8fe1-815ecaedfc1b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089185 Feb 21 02:40:00.997030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 583/1135] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:40:01.896767 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:01.897374 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:01.904322 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:01.904767 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:01.905538 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:01.905999 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:02.037188 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:02.044862 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:02.046376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:02.047521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-f234061d-4a40-4d43-9e06-47740aeacc9e tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.154516 Feb 21 02:40:02.048081 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 553/1136] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:40:01 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:40:03.066487 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:03.067188 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:03.073383 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:03.073948 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:03.074738 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:03.075179 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:03.211455 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:03.219869 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:03.221443 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:03.222728 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ea98cbe3-5e87-4be4-8089-4f436c494898 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1733 microversion: 2.20 time: 0.160863 Feb 21 02:40:03.223370 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 584/1137] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:40:03 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:40:04.241797 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:04.242401 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:04.249354 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:04.249829 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:04.250595 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:04.251026 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:04.385521 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:04.393725 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:04.395241 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:04.396390 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-aa24693f-3106-4b4b-aa9f-751b88f2e7f1 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1720 microversion: 2.20 time: 0.158290 Feb 21 02:40:04.396939 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 554/1138] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:40:04 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:40:32.925262 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-5f39008d-6fca-4882-a621-5e71dfa5befa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:32.925800 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5f39008d-6fca-4882-a621-5e71dfa5befa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:32.931979 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5f39008d-6fca-4882-a621-5e71dfa5befa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:32.932436 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5f39008d-6fca-4882-a621-5e71dfa5befa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:32.933068 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-4a5dacef-345e-4255-97e2-e72995d3bab9 req-e8ba5b54-03a1-46d9-acd0-289094e249a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c26b82-838e-4a45-9728-070472b9798d", "tag": "74031657-e31e-49d9-87d8-c7e6cbbd9e87"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:40:32.934094 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5f39008d-6fca-4882-a621-5e71dfa5befa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:32.934405 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-5f39008d-6fca-4882-a621-5e71dfa5befa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:32.935285 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:40:32.935285 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:40:32.942210 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-4a5dacef-345e-4255-97e2-e72995d3bab9 req-e8ba5b54-03a1-46d9-acd0-289094e249a8 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:32.942650 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-4a5dacef-345e-4255-97e2-e72995d3bab9 req-e8ba5b54-03a1-46d9-acd0-289094e249a8 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:32.953729 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-4a5dacef-345e-4255-97e2-e72995d3bab9 req-e8ba5b54-03a1-46d9-acd0-289094e249a8 service nova] Creating event network-changed:74031657-e31e-49d9-87d8-c7e6cbbd9e87 for instance 39c26b82-838e-4a45-9728-070472b9798d on hv-cinder-80447 Feb 21 02:40:32.958950 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-4a5dacef-345e-4255-97e2-e72995d3bab9 req-e8ba5b54-03a1-46d9-acd0-289094e249a8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029252 Feb 21 02:40:32.959118 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-5f39008d-6fca-4882-a621-5e71dfa5befa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:40:32.959718 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 555/1139] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:40:33.043659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-5f39008d-6fca-4882-a621-5e71dfa5befa tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "DELETE /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 204 len: 0 microversion: 2.1 time: 0.120951 Feb 21 02:40:33.047306 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 585/1140] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:40:32 2022] DELETE /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 02:40:33.053099 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c62d7915-ea3e-407a-bfa1-08a9671d2912 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:33.054445 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c62d7915-ea3e-407a-bfa1-08a9671d2912 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:33.061411 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62d7915-ea3e-407a-bfa1-08a9671d2912 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:33.061941 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62d7915-ea3e-407a-bfa1-08a9671d2912 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:33.062747 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62d7915-ea3e-407a-bfa1-08a9671d2912 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:33.063178 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c62d7915-ea3e-407a-bfa1-08a9671d2912 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:33.567576 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c62d7915-ea3e-407a-bfa1-08a9671d2912 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:33.577478 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c62d7915-ea3e-407a-bfa1-08a9671d2912 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1576 microversion: 2.1 time: 0.528408 Feb 21 02:40:33.585754 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 556/1141] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:40:33 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1576 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:40:34.595592 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-375dcc54-f700-4fed-92aa-1d087e897bfe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:34.596290 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-375dcc54-f700-4fed-92aa-1d087e897bfe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:34.602553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-375dcc54-f700-4fed-92aa-1d087e897bfe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:34.603002 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-375dcc54-f700-4fed-92aa-1d087e897bfe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:34.603774 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-375dcc54-f700-4fed-92aa-1d087e897bfe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:34.604212 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-375dcc54-f700-4fed-92aa-1d087e897bfe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:34.742190 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-375dcc54-f700-4fed-92aa-1d087e897bfe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:34.750104 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-375dcc54-f700-4fed-92aa-1d087e897bfe tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1457 microversion: 2.1 time: 0.158507 Feb 21 02:40:34.750674 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 586/1142] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:40:34 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:40:35.462274 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-6c5e0715-77b2-4b83-84db-ffe09f4135e8 req-d43e386f-1be0-4421-b83b-59d7567e438c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c26b82-838e-4a45-9728-070472b9798d", "name": "network-vif-deleted", "tag": "74031657-e31e-49d9-87d8-c7e6cbbd9e87"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:40:35.463873 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:40:35.463873 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:40:35.472472 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-6c5e0715-77b2-4b83-84db-ffe09f4135e8 req-d43e386f-1be0-4421-b83b-59d7567e438c service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:35.472910 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-6c5e0715-77b2-4b83-84db-ffe09f4135e8 req-d43e386f-1be0-4421-b83b-59d7567e438c service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:35.484806 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-6c5e0715-77b2-4b83-84db-ffe09f4135e8 req-d43e386f-1be0-4421-b83b-59d7567e438c service nova] Creating event network-vif-deleted:74031657-e31e-49d9-87d8-c7e6cbbd9e87 for instance 39c26b82-838e-4a45-9728-070472b9798d on hv-cinder-80447 Feb 21 02:40:35.489911 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-6c5e0715-77b2-4b83-84db-ffe09f4135e8 req-d43e386f-1be0-4421-b83b-59d7567e438c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 Feb 21 02:40:35.490509 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 557/1143] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:40:35.768501 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:35.769281 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:35.778206 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:35.778702 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:35.779553 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:35.780080 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:35.818363 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:35.818817 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:35.819271 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.objects.instance [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lazy-loading 'fault' on Instance uuid 39c26b82-838e-4a45-9728-070472b9798d {{(pid=116711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 02:40:35.867209 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:35.875939 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-4f788907-0685-45fe-a050-b1cf176f3db9 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 200 len: 1228 microversion: 2.1 time: 0.111108 Feb 21 02:40:35.876531 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 587/1144] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:40:35 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 1228 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 02:40:36.893405 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:36.894126 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 39c26b82-838e-4a45-9728-070472b9798d] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:36.900224 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:36.900670 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:36.901431 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:36.902412 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:36.915075 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] HTTP exception thrown: Instance 39c26b82-838e-4a45-9728-070472b9798d could not be found. Feb 21 02:40:36.915643 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Returning 404 to user: Instance 39c26b82-838e-4a45-9728-070472b9798d could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:40:36.916467 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-2a5b8cc6-d113-4f87-b55c-db36b33db441 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d" status: 404 len: 111 microversion: 2.1 time: 0.027550 Feb 21 02:40:36.916977 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 558/1145] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:40:36 2022] GET /compute/v2.1/servers/39c26b82-838e-4a45-9728-070472b9798d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:40:39.965962 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-dd0638d0-35b9-4a85-afed-a03de1566690 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:39.966475 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dd0638d0-35b9-4a85-afed-a03de1566690 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:39.972926 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dd0638d0-35b9-4a85-afed-a03de1566690 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:39.973381 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dd0638d0-35b9-4a85-afed-a03de1566690 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:39.974111 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-14c7e1d5-9397-4140-a430-ff39af011e38 req-6b8fc9f9-fea2-41f2-9bdd-1c21c96db8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44f197d-6813-4c77-8283-ce1b523de6cd", "tag": "b9cfa993-4c52-40b7-9623-8c41c63c23f3"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:40:39.974555 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dd0638d0-35b9-4a85-afed-a03de1566690 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:39.974644 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-dd0638d0-35b9-4a85-afed-a03de1566690 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:39.976048 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:40:39.976048 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:40:39.984337 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-14c7e1d5-9397-4140-a430-ff39af011e38 req-6b8fc9f9-fea2-41f2-9bdd-1c21c96db8d3 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:39.984886 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-14c7e1d5-9397-4140-a430-ff39af011e38 req-6b8fc9f9-fea2-41f2-9bdd-1c21c96db8d3 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:39.996458 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-14c7e1d5-9397-4140-a430-ff39af011e38 req-6b8fc9f9-fea2-41f2-9bdd-1c21c96db8d3 service nova] Creating event network-changed:b9cfa993-4c52-40b7-9623-8c41c63c23f3 for instance f44f197d-6813-4c77-8283-ce1b523de6cd on hv-cinder-80447 Feb 21 02:40:40.001775 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-14c7e1d5-9397-4140-a430-ff39af011e38 req-6b8fc9f9-fea2-41f2-9bdd-1c21c96db8d3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031081 Feb 21 02:40:40.002707 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 559/1146] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:40:40.003680 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-dd0638d0-35b9-4a85-afed-a03de1566690 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Going to try to terminate instance {{(pid=116711) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:40:40.085606 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-dd0638d0-35b9-4a85-afed-a03de1566690 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 204 len: 0 microversion: 2.1 time: 0.122865 Feb 21 02:40:40.086840 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 588/1147] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:40:39 2022] DELETE /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 02:40:40.096195 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c1e84b56-f9c3-421d-852f-10e7dc170112 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:40.097125 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-c1e84b56-f9c3-421d-852f-10e7dc170112 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:40.103307 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c1e84b56-f9c3-421d-852f-10e7dc170112 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:40.103762 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c1e84b56-f9c3-421d-852f-10e7dc170112 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:40.104551 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c1e84b56-f9c3-421d-852f-10e7dc170112 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:40.105612 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-c1e84b56-f9c3-421d-852f-10e7dc170112 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:40.357347 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-c1e84b56-f9c3-421d-852f-10e7dc170112 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:40.370051 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c1e84b56-f9c3-421d-852f-10e7dc170112 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1577 microversion: 2.1 time: 0.277882 Feb 21 02:40:40.371388 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 560/1148] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:40:40 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:40:41.389221 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-b874d74d-d4ba-42bb-bcc5-8c85fcf3d9ed tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:41.389958 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-b874d74d-d4ba-42bb-bcc5-8c85fcf3d9ed tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:41.396476 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b874d74d-d4ba-42bb-bcc5-8c85fcf3d9ed tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:41.396925 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b874d74d-d4ba-42bb-bcc5-8c85fcf3d9ed tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:41.397748 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b874d74d-d4ba-42bb-bcc5-8c85fcf3d9ed tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:41.398187 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-b874d74d-d4ba-42bb-bcc5-8c85fcf3d9ed tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:41.460127 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-b874d74d-d4ba-42bb-bcc5-8c85fcf3d9ed tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e81057507d24a2ca8f7b57eef422397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0c19115c1746f1956552777cc35baf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:40:41.467823 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-b874d74d-d4ba-42bb-bcc5-8c85fcf3d9ed tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 200 len: 1224 microversion: 2.1 time: 0.083521 Feb 21 02:40:41.468384 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 589/1149] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:40:41 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:40:42.017143 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-1e1f9895-1a00-4b9d-a728-ced8888b4c18 req-1f3f83c4-b276-4c8b-a7cc-cdc2a83348c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f197d-6813-4c77-8283-ce1b523de6cd", "name": "network-vif-deleted", "tag": "b9cfa993-4c52-40b7-9623-8c41c63c23f3"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:40:42.018710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:40:42.018710 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:40:42.025828 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-1e1f9895-1a00-4b9d-a728-ced8888b4c18 req-1f3f83c4-b276-4c8b-a7cc-cdc2a83348c5 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:42.026280 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-1e1f9895-1a00-4b9d-a728-ced8888b4c18 req-1f3f83c4-b276-4c8b-a7cc-cdc2a83348c5 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:42.036875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-1e1f9895-1a00-4b9d-a728-ced8888b4c18 req-1f3f83c4-b276-4c8b-a7cc-cdc2a83348c5 service nova] Creating event network-vif-deleted:b9cfa993-4c52-40b7-9623-8c41c63c23f3 for instance f44f197d-6813-4c77-8283-ce1b523de6cd on hv-cinder-80447 Feb 21 02:40:42.041633 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-1e1f9895-1a00-4b9d-a728-ced8888b4c18 req-1f3f83c4-b276-4c8b-a7cc-cdc2a83348c5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028230 Feb 21 02:40:42.042314 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 561/1150] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 02:40:42.484508 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:42.485116 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: f44f197d-6813-4c77-8283-ce1b523de6cd] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:42.491808 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:42.492257 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:42.493028 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:42.493459 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:42.506722 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] HTTP exception thrown: Instance f44f197d-6813-4c77-8283-ce1b523de6cd could not be found. Feb 21 02:40:42.507293 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Returning 404 to user: Instance f44f197d-6813-4c77-8283-ce1b523de6cd could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:40:42.508085 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-a616c325-e9d3-4a27-8c35-4e56bedb4158 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd" status: 404 len: 111 microversion: 2.1 time: 0.027412 Feb 21 02:40:42.508604 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 590/1151] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:40:42 2022] GET /compute/v2.1/servers/f44f197d-6813-4c77-8283-ce1b523de6cd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:40:42.952737 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:42.953340 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:42.959576 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:42.960026 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:42.960915 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:42.961358 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:42.974736 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] HTTP exception thrown: Instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e could not be found. Feb 21 02:40:42.975312 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Returning 404 to user: Instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:40:42.976119 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-8b39500e-eef4-4f10-bc13-4cfbc7b31c44 tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "DELETE /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 404 len: 111 microversion: 2.1 time: 0.027535 Feb 21 02:40:42.976654 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 562/1152] 10.222.0.75 () {58 vars in 1238 bytes} [Mon Feb 21 02:40:42 2022] DELETE /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:40:42.985233 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:42.985879 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] [instance: 65e88ba1-3efc-43bb-a9fe-cea1161d320e] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:42.991938 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:42.992385 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:42.993159 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:42.993595 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:43.006761 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] HTTP exception thrown: Instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e could not be found. Feb 21 02:40:43.007332 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Returning 404 to user: Instance 65e88ba1-3efc-43bb-a9fe-cea1161d320e could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:40:43.008132 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-80cc1200-7965-4ec9-890c-ea5dd7c7164c tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e" status: 404 len: 111 microversion: 2.1 time: 0.026557 Feb 21 02:40:43.008655 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 591/1153] 10.222.0.75 () {58 vars in 1235 bytes} [Mon Feb 21 02:40:42 2022] GET /compute/v2.1/servers/65e88ba1-3efc-43bb-a9fe-cea1161d320e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 02:40:44.280924 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-c000ffb2-ee62-4802-bdcc-6019103b411d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] Calling method '.version_select at 0x7fd85c08e0d0>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:44.302130 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-c000ffb2-ee62-4802-bdcc-6019103b411d tempest-TestVolumeBootPattern-56898399 tempest-TestVolumeBootPattern-56898399-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-72472954" status: 202 len: 0 microversion: 2.1 time: 0.024977 Feb 21 02:40:44.302708 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 563/1154] 10.222.0.75 () {58 vars in 1256 bytes} [Mon Feb 21 02:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-72472954 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 02:40:52.206186 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:40:52.206856 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: Mon Feb 21 02:40:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:40:59.805300 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-eaa7bdb0-a59f-467b-a0fd-23d9dacc037a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:59.806305 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-eaa7bdb0-a59f-467b-a0fd-23d9dacc037a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:59.812434 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-eaa7bdb0-a59f-467b-a0fd-23d9dacc037a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:59.812884 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-eaa7bdb0-a59f-467b-a0fd-23d9dacc037a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:59.813668 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-eaa7bdb0-a59f-467b-a0fd-23d9dacc037a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:59.814114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-eaa7bdb0-a59f-467b-a0fd-23d9dacc037a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:59.844947 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-eaa7bdb0-a59f-467b-a0fd-23d9dacc037a tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043389 Feb 21 02:40:59.845516 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 592/1155] 10.222.0.75 () {60 vars in 1342 bytes} [Mon Feb 21 02:40:59 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 02:40:59.907596 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-9febf67e-db02-44c8-84f7-d4a83d0ff438 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:40:59.908246 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9febf67e-db02-44c8-84f7-d4a83d0ff438 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:40:59.916996 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9febf67e-db02-44c8-84f7-d4a83d0ff438 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:59.917594 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9febf67e-db02-44c8-84f7-d4a83d0ff438 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:59.918652 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9febf67e-db02-44c8-84f7-d4a83d0ff438 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:40:59.919180 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-9febf67e-db02-44c8-84f7-d4a83d0ff438 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:40:59.953661 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-9febf67e-db02-44c8-84f7-d4a83d0ff438 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Going to try to terminate instance {{(pid=116710) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 02:41:00.027415 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-9febf67e-db02-44c8-84f7-d4a83d0ff438 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 204 len: 0 microversion: 2.20 time: 0.124403 Feb 21 02:41:00.028037 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 564/1156] 10.222.0.75 () {60 vars in 1279 bytes} [Mon Feb 21 02:40:59 2022] DELETE /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 02:41:00.036130 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:00.036736 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:41:00.042824 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:00.043354 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:00.044069 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:00.044505 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:00.177612 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:00.185933 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:00.187413 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:00.188561 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-0123f217-7001-427f-a892-539f33544bd5 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.156148 Feb 21 02:41:00.189114 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 593/1157] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:41:00 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 02:41:01.207875 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:01.208562 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:41:01.215456 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:01.215903 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:01.216874 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:01.217087 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:01.350177 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:01.358141 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:01.359613 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.policy [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116710) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:01.360751 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-e762d300-ba4b-404d-bb6c-8593adff3ef6 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1726 microversion: 2.20 time: 0.156959 Feb 21 02:41:01.361318 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 565/1158] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:41:01 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:41:02.380284 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:02.380876 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:41:02.387949 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:02.388402 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:02.389205 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:02.389662 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:02.454659 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:02.462906 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:02.464942 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.policy [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe4f394cc0a14d4e98d173a0f081bb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6331fee47dce4e8b88574ea961f8b9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116711) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 02:41:02.466160 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-af0aa6f7-3720-4a04-ae30-7489e0887f20 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 200 len: 1658 microversion: 2.20 time: 0.089655 Feb 21 02:41:02.466729 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 594/1159] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:41:02 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 1658 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 02:41:02.696107 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [req-8934bd47-fca0-4ef2-8883-b5ff9ad4fb67 req-20aed83b-c338-485d-b994-10bdc76672f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0405d8a-efb9-44d0-a689-bf32224aefbc", "name": "network-vif-deleted", "tag": "49c16a7e-5b17-4b9c-8fa6-77d95496d4b8"}]} {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 02:41:02.697969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 02:41:02.697969 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: warnings.warn(msg) Feb 21 02:41:02.707203 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-8934bd47-fca0-4ef2-8883-b5ff9ad4fb67 req-20aed83b-c338-485d-b994-10bdc76672f5 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:02.707641 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [req-8934bd47-fca0-4ef2-8883-b5ff9ad4fb67 req-20aed83b-c338-485d-b994-10bdc76672f5 service nova] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:02.721097 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.compute.server_external_events [req-8934bd47-fca0-4ef2-8883-b5ff9ad4fb67 req-20aed83b-c338-485d-b994-10bdc76672f5 service nova] Creating event network-vif-deleted:49c16a7e-5b17-4b9c-8fa6-77d95496d4b8 for instance c0405d8a-efb9-44d0-a689-bf32224aefbc on hv-cinder-80447 Feb 21 02:41:02.726360 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [req-8934bd47-fca0-4ef2-8883-b5ff9ad4fb67 req-20aed83b-c338-485d-b994-10bdc76672f5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034229 Feb 21 02:41:02.726781 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 566/1160] 10.222.0.75 () {64 vars in 1317 bytes} [Mon Feb 21 02:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 02:41:03.485084 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:03.485696 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:41:03.492546 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:03.493046 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:03.493886 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:03.494317 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:03.508089 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] HTTP exception thrown: Instance c0405d8a-efb9-44d0-a689-bf32224aefbc could not be found. Feb 21 02:41:03.508662 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Returning 404 to user: Instance c0405d8a-efb9-44d0-a689-bf32224aefbc could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:41:03.509492 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-696d2cde-e4f6-43e0-8bf1-f18076841d17 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 404 len: 111 microversion: 2.20 time: 0.028324 Feb 21 02:41:03.510051 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 595/1161] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:41:03 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 02:41:03.518878 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-d87ed02c-3413-461c-a55e-37f997107e74 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '.version_select at 0x7fd8577265e0>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:03.537986 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-d87ed02c-3413-461c-a55e-37f997107e74 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794736353" status: 204 len: 0 microversion: 2.20 time: 0.023139 Feb 21 02:41:03.538573 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 567/1162] 10.222.0.75 () {60 vars in 1261 bytes} [Mon Feb 21 02:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794736353 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 02:41:05.282735 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:05.283232 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:41:05.289327 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:05.289825 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:05.290600 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:05.291030 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:05.304092 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] HTTP exception thrown: Instance c0405d8a-efb9-44d0-a689-bf32224aefbc could not be found. Feb 21 02:41:05.304663 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Returning 404 to user: Instance c0405d8a-efb9-44d0-a689-bf32224aefbc could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:41:05.305447 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-ae52ce33-d31a-4147-bc61-3f6fdc31e5b9 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 404 len: 111 microversion: 2.20 time: 0.026773 Feb 21 02:41:05.305993 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 596/1163] 10.222.0.75 () {60 vars in 1279 bytes} [Mon Feb 21 02:41:05 2022] DELETE /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 02:41:05.314427 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:05.315148 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: c0405d8a-efb9-44d0-a689-bf32224aefbc] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:41:05.321141 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:05.321585 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:05.322376 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:05.322804 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:05.336422 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] HTTP exception thrown: Instance c0405d8a-efb9-44d0-a689-bf32224aefbc could not be found. Feb 21 02:41:05.336935 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Returning 404 to user: Instance c0405d8a-efb9-44d0-a689-bf32224aefbc could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:41:05.337803 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-99d6e4fe-6588-45a1-bbf3-5e986c2b1657 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc" status: 404 len: 111 microversion: 2.20 time: 0.027450 Feb 21 02:41:05.338331 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 568/1164] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:41:05 2022] GET /compute/v2.1/servers/c0405d8a-efb9-44d0-a689-bf32224aefbc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 02:41:06.465393 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:06.465921 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.compute.api [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116711) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:41:06.472178 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:06.472624 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:06.473382 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:06.473854 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG oslo_concurrency.lockutils [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:06.487409 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.wsgi [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] HTTP exception thrown: Instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 could not be found. Feb 21 02:41:06.487971 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: DEBUG nova.api.openstack.wsgi [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Returning 404 to user: Instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 could not be found. {{(pid=116711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:41:06.488760 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO nova.api.openstack.requestlog [None req-d15f095f-0a19-40c3-87e6-457396ab5e83 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 404 len: 111 microversion: 2.20 time: 0.027107 Feb 21 02:41:06.489273 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: [pid: 116711|app: 0|req: 597/1165] 10.222.0.75 () {60 vars in 1279 bytes} [Mon Feb 21 02:41:06 2022] DELETE /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 02:41:06.496851 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Calling method '>' {{(pid=116710) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 02:41:06.498302 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.compute.api [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] [instance: a8b8e707-e1a8-46b8-8b47-ef1d9ef77903] Fetching instance by UUID {{(pid=116710) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 02:41:06.504504 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:06.504954 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:06.505757 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 02:41:06.506200 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG oslo_concurrency.lockutils [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Lock "33d1b4dd-d433-46ca-94fc-ac9f89dc5606" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116710) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 02:41:06.519015 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.wsgi [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] HTTP exception thrown: Instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 could not be found. Feb 21 02:41:06.519591 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: DEBUG nova.api.openstack.wsgi [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] Returning 404 to user: Instance a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 could not be found. {{(pid=116710) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 02:41:06.520394 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO nova.api.openstack.requestlog [None req-1b36ba13-7223-4f73-9ceb-58c476b5cc88 tempest-AttachVolumeShelveTestJSON-1169852837 tempest-AttachVolumeShelveTestJSON-1169852837-project] 10.222.0.75 "GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903" status: 404 len: 111 microversion: 2.20 time: 0.027262 Feb 21 02:41:06.520913 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: [pid: 116710|app: 0|req: 569/1166] 10.222.0.75 () {60 vars in 1276 bytes} [Mon Feb 21 02:41:06 2022] GET /compute/v2.1/servers/a8b8e707-e1a8-46b8-8b47-ef1d9ef77903 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 02:42:33.086291 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:42:33.086919 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: Mon Feb 21 02:42:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:42:55.346253 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:42:55.346810 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: Mon Feb 21 02:42:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:43:18.226571 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:43:18.227227 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: Mon Feb 21 02:43:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:44:12.214568 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:44:12.215294 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: Mon Feb 21 02:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:44:19.618029 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:44:19.618567 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: Mon Feb 21 02:44:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:45:53.094228 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:45:53.094938 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: Mon Feb 21 02:45:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:46:10.744294 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:46:10.745044 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: Mon Feb 21 02:46:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:46:15.354528 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:46:15.355111 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: Mon Feb 21 02:46:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:46:38.234687 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:46:38.235438 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: Mon Feb 21 02:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:47:32.222681 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:47:32.223400 dv-cinder-804470-8-iscsi devstack@n-api.service[116711]: Mon Feb 21 02:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 02:47:39.626816 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 02:47:39.627326 dv-cinder-804470-8-iscsi devstack@n-api.service[116710]: Mon Feb 21 02:47:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!